-- Logs begin at Thu 2022-07-07 06:36:19 UTC, end at Thu 2022-07-07 07:41:17 UTC. -- Jul 07 07:11:28.446326 dv-cinder-826608-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 07 07:11:28.456042 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 7 07:11:28 2022] *** Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: nodename: dv-cinder-826608-5-iscsi Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: machine: x86_64 Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: clock source: unix Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: pcre jit disabled Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: detected number of CPU cores: 4 Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: current working directory: / Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: detected binary path: /usr/bin/uwsgi-core Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: your processes number limit is 47680 Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: your memory page size is 4096 bytes Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: detected max file descriptor number: 2048 Jul 07 07:11:28.458238 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: lock engine: pthread robust mutexes Jul 07 07:11:28.459157 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: thunder lock: enabled Jul 07 07:11:28.459157 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 07 07:11:28.459157 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 07 07:11:28.503875 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: Python main interpreter initialized at 0x5629e786f9c0 Jul 07 07:11:28.503875 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: python threads support enabled Jul 07 07:11:28.503875 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: your server socket listen backlog is limited to 100 connections Jul 07 07:11:28.503875 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: your mercy for graceful operations on workers is 90 seconds Jul 07 07:11:28.504409 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: mapped 403077 bytes (393 KB) for 2 cores Jul 07 07:11:28.504409 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: *** Operational MODE: preforking *** Jul 07 07:11:28.504635 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: *** uWSGI is running in multiple interpreter mode *** Jul 07 07:11:28.504635 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: spawned uWSGI master process (pid: 103281) Jul 07 07:11:28.504738 dv-cinder-826608-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 07 07:11:28.505454 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: spawned uWSGI worker 1 (pid: 103282, cores: 1) Jul 07 07:11:28.505673 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: spawned uWSGI worker 2 (pid: 103283, cores: 1) Jul 07 07:11:28.505797 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 07 07:11:29.160075 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 07:11:29.172642 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 07:11:30.263039 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:11:30.263039 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: from cryptography.utils import int_from_bytes Jul 07 07:11:30.263727 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:11:30.263727 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: from cryptography.utils import int_from_bytes Jul 07 07:11:30.266068 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:11:30.266068 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: from cryptography.utils import int_from_bytes Jul 07 07:11:30.266545 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:11:30.266545 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: from cryptography.utils import int_from_bytes Jul 07 07:11:32.691776 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 07:11:32.692358 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 07:11:32.692463 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 07:11:32.692766 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 07:11:32.693008 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 07:11:32.693415 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.693736 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.694056 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.694370 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.694695 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.695000 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.695314 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.695606 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.695926 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.696027 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 07:11:32.696386 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.696495 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 07:11:32.696582 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.696784 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-5-iscsi {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.696873 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 07:11:32.697100 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.697196 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 07:11:32.697431 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.697571 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 07:11:32.697701 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.697823 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.698030 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.698168 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.698329 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.698458 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.698657 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.698785 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.698957 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.699098 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.699341 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.699468 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.699665 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.700605 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.700753 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.700867 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.700992 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.701142 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.701299 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.701415 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.701618 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.701742 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.701854 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-5-iscsi {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.701972 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.702092 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.702226 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.702347 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.702467 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.702596 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.702707 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.702825 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.702958 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.703081 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.703081 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.703325 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-5-iscsi {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.703457 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.703579 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.703579 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.703833 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.703970 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.704112 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.704230 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.704350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.704547 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.704676 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.704852 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.704992 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.705165 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.705325 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.705517 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.705656 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.705778 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.705912 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.706120 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.706278 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.706477 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.706608 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.706744 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.706873 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.707136 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.707275 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-5-iscsi {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.707406 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.707537 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.707725 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.707862 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.707997 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.708127 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.708328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.708457 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.708630 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.708759 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.708921 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.709050 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.709171 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.709400 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.709540 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.709728 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.709868 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.710003 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.710125 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.710349 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.710476 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.710616 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.710754 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.710877 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.711000 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.711129 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.711251 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.711461 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.711592 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.711759 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.711888 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.712070 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.712199 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.712359 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.712490 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.712667 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.712812 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.712935 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.713070 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.713264 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.713407 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.713573 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.713672 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.713886 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.714040 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.714168 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.714288 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.714491 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.714621 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.714744 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.714877 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.715000 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.715132 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.715263 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.715385 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.715598 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.715737 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.715908 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.716044 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.716207 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.716343 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.716528 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.716656 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.716834 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.716961 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.717147 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.717306 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.717443 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.717582 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.717762 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.717897 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.718068 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.718205 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.718386 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.718522 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.718685 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.718820 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.718982 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.719121 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.719296 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.719426 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.719606 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.719732 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.719861 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.719996 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.720117 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.720250 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.720420 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.720548 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.720735 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.720872 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.721024 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.721152 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.721357 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.721498 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.721633 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.721767 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.721946 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.722074 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.722245 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.722383 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.722677 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.722809 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.722987 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.723118 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.723293 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.723421 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.723588 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.723725 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.723898 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.724028 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.724177 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.724304 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.724499 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.724628 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.724778 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.724912 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.725100 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.725285 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.725424 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.725558 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.725710 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.725837 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.726026 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.726162 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.726284 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.726411 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.726605 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.726744 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.726896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.727021 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.727209 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.727335 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.727512 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.727650 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.727802 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.727938 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.728114 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.728250 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.728402 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.728527 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.728716 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.728854 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.729006 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.729133 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.729337 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.729477 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.729653 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.729791 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.729943 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.730070 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.730249 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.730381 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.730558 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.730694 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.730832 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.730960 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.731146 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.731276 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.731453 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.731656 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.731779 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.731900 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.732061 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.732184 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.732365 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.732499 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.732659 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.732782 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.732960 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.733085 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.733280 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.733406 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.733590 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.733715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.733903 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.734027 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.734200 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.734332 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.734499 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.734622 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.734800 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.734925 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.735101 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.735233 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.735404 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.735528 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.735705 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.735837 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.736010 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.736135 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.736316 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.736448 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.736619 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.736752 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.736919 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.737043 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.737252 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.737378 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.737541 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.737678 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.737861 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.737985 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.738249 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.738382 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.738587 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.738722 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.738895 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.739019 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.739200 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.739324 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.739520 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:11:32.739653 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.739855 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.739978 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.740181 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.740307 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.740495 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.740628 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.740805 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.740938 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.741119 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.741263 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.741455 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.741582 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.741770 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.741901 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.742079 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.742224 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.742396 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.742531 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.742701 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.742825 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.743017 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.743141 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.743329 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.743462 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.743640 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.743774 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.743954 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.744080 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.744267 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.744404 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.744575 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.744701 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.744885 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.745036 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.745192 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.745371 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.745534 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.745658 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.745849 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.745984 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.746195 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.746319 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.746511 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.746637 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.746819 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.746954 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.747125 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.747252 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.747430 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.747548 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.747737 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.747876 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.748044 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.748169 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.748374 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.748499 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.748692 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.748818 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.749001 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.749136 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.749332 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.749469 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.749645 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.749771 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.749974 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.750098 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.750293 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.750417 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.750598 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.750725 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.750913 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.751039 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.751223 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.751355 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.751522 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.751656 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.751831 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.751953 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.752141 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.752274 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.752451 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.752576 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.752785 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.752910 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.753084 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.753276 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.753429 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.753553 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.753754 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.753878 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.754063 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.754265 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.754389 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.754522 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.754667 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.754799 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.754970 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.755106 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.755271 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.755396 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.755575 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.755706 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.755875 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.756011 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.756181 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.756311 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.756484 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.756607 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.756791 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.756921 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.757107 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.757261 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.757433 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.757551 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.757735 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.757864 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.758046 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.758172 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.758350 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.758476 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.758658 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.758782 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.758962 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.759085 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.759263 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.759394 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.759576 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.759702 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.759879 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.760014 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.760184 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.760318 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.760514 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.760638 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.760823 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.760947 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.761125 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.761300 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.761469 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.761607 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.761774 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.761901 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.762080 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.762219 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.762382 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.762507 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.762690 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.762817 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.762994 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.763136 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.763296 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.763420 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.763604 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.763729 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.763904 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.764031 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.764204 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.764329 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.764504 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.764629 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.764802 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.764936 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.765101 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.765249 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.765434 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.765559 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.765750 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.765877 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.766056 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.766181 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.766353 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.766479 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.766657 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.766783 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.766959 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.767083 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.767269 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.767406 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.767573 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.767698 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.767876 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.768000 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.768186 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.768328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.768490 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.768615 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.768793 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.768918 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.769096 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.769278 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.769474 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.769603 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.769779 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.769918 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.770101 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.770235 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.770411 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.770535 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.770714 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.770837 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.771012 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.771137 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.771314 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.771439 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.771626 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.771749 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.771932 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.772053 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.772250 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.772374 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.772557 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.772683 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.772872 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.773004 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.773172 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.773328 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.773510 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.773643 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.773846 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.773973 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.774172 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.774297 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.774485 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.774611 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.774802 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.774928 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.775107 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.775233 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.775418 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.775552 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.775724 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.775849 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.776029 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.776162 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.776333 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.776468 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.776638 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.776763 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.776950 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.777076 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.777272 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.777412 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.777586 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.777712 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.777891 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.778018 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.778208 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.778347 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.778513 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.778637 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.778832 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.778965 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.779135 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.779268 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.779445 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.779576 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.779760 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.779897 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.780078 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.780212 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.780378 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.780510 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.780682 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.780805 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.780992 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.781118 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.781320 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.781445 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.781629 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.781754 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.781937 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.782063 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.782243 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.782366 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.782542 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.782744 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.782876 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.782999 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.783150 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.783277 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.783450 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.783588 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.783754 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.783878 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.784054 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.784178 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.784365 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.784504 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.784671 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.784795 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.784997 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.785122 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.785323 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.785462 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.785631 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.785758 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.785941 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.786065 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.786244 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.786380 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.786549 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.786681 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.786855 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.786988 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.787152 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.787276 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.787451 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.787577 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.787759 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.787892 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.788059 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.788183 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.788358 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.788499 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.788666 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.788801 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.788963 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.789089 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.789283 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.789424 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.789592 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.789717 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.789903 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.790028 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.790214 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.790338 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.790528 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.790667 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.790831 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.790965 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.791142 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.791267 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.791446 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.791578 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.791750 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.791873 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.792067 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.792191 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.792380 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.792530 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.792681 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.792866 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.792988 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.793108 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.793282 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.793417 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.793606 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.793731 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.793912 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.794038 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.794213 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.794345 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.794528 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.794661 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.794835 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.794960 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.795141 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.795265 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.795438 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.795565 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.795743 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.795874 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.796049 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.796173 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.796375 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.796620 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.796749 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.796949 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.797083 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.797282 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.797410 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.797603 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.797725 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.797915 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.798042 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.798226 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.798350 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.798548 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.798680 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.798855 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.798980 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.799164 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.799288 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.799473 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.799608 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.799775 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.799907 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.800075 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.800210 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.800376 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.800501 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.800787 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.801010 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.801137 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.801369 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.801495 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.801694 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.801818 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.801997 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.802123 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.802306 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.802427 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.802592 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.802727 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.802892 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.803026 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.803191 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.803317 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.803501 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.803634 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.803802 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.803957 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.804108 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.804234 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.804411 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.804540 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.804729 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.804856 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.805037 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.805163 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.805363 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.805489 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.805662 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.805790 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.805962 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.806095 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.806299 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.806437 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.806635 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.806759 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.806881 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.807000 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.807181 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.807313 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.807484 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.807611 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.807797 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.807930 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.808102 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.808236 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.808413 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.808548 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.808715 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.808839 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.809014 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.809146 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.809347 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.809474 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.809640 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.809763 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.809941 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.810079 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.810239 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.810364 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.810543 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.810660 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.810846 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.810980 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.811152 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.811277 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.811455 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.811582 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.811753 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.811879 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.812056 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.812182 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.812354 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.812479 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.812664 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.812790 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.812978 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.813110 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.813654 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.813783 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.813958 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.814093 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.814264 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.814387 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.814565 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.814692 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.814863 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.814981 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.815167 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.815292 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.815463 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.815604 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.815771 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.815903 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.816069 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.816211 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.816391 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.816539 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.816692 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.816819 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.816991 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.817122 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.817318 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.817460 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.817620 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.817744 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.817920 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.818044 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.818224 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.818361 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.818530 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.818655 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.818835 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.818960 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.819138 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.819262 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.819440 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.819574 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.819739 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.819862 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.820047 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.820172 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.820349 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.820473 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.820652 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.820776 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.820960 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.821085 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.821295 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.821421 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.821598 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.821723 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.821897 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.822021 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.822203 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.822327 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.822509 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.822645 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.822808 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.822939 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.823109 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.823240 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.823560 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.823748 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.823874 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.823996 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.824127 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.824259 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.824390 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.824527 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.824650 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.824789 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.824932 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.825084 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.825245 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.825384 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.825507 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.825698 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.825824 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.826086 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.826220 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.826408 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.826560 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.826736 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.826871 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.827050 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.827186 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.827356 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.827481 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.827665 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.827788 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.827968 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.828106 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.828282 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.828407 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.828579 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.828702 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.828887 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.829026 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.829199 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.829396 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.829573 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.829710 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.829879 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.830007 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.830181 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.830306 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.830498 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.830622 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.830804 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.830930 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.831109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.831243 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.831423 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.831550 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.831740 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.831912 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.832216 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.832348 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.832530 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.832655 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.832842 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.832968 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.833157 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.833303 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.833491 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.833629 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.833796 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.833921 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.834102 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.834226 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.834409 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.834548 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.834709 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.834840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.835011 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.835143 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.835316 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.835521 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.835647 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.835780 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.835903 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.836024 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.836200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.836342 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.836504 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.836643 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.836804 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.836930 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.837126 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.837332 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.837465 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.837588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.837743 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.837869 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.838051 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.838175 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.838347 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.838464 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.838654 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.838776 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.838981 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.839105 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.839366 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.839535 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.839702 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.839828 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.840018 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.840144 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.840328 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.840452 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.840635 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.840760 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.840945 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.841072 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.841274 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.841402 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.841584 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.841726 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.841882 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.842007 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.842206 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.842329 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.842511 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.842646 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.842823 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.842948 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.843130 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.843256 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.843443 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.843581 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.843741 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.843865 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.844054 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.844189 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.844370 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.844497 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.844672 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.844798 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.844975 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.845101 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.845289 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.845434 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.845608 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.845734 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.845908 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.846041 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.846226 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.846352 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.846576 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.846699 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.846927 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.847050 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.847234 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.847361 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.847613 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.847740 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.848123 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.848271 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.848399 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.848520 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.848636 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.848760 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.848881 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.849017 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.849179 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.849333 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.849504 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.849629 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.849815 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.849954 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.850121 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.850247 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.850441 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.850566 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.850745 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.850879 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.851051 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.851174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.851362 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.851487 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.851670 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.851804 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.851993 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.852138 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.852312 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.852471 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.852622 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.852787 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.852942 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.853101 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.853381 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.853522 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.853703 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.853829 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.854009 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.854143 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.854339 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.854464 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.854658 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.854789 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.854960 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.855087 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.855260 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.855386 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.855568 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.855695 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.855871 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.855998 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.856174 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.856330 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.856483 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.856619 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.856785 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.856911 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.857092 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.857268 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.857423 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.857572 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.857729 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.857855 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.858029 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.858154 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.858327 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.858462 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.858650 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.858777 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.858951 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.859087 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.859268 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.859404 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.859576 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.859710 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.859894 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.860019 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.860208 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.860336 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.860509 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.860636 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.860827 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.860966 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.861132 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.861281 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.861457 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.861585 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.861758 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.861893 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.862056 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.862184 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.862363 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.862497 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.862668 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.862793 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.862971 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.863118 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.863352 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.863478 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.863659 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.863795 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.863982 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.864116 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.864296 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.864421 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.864623 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.864756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.864937 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.865065 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.865258 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.865386 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.865584 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.865725 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.865888 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.866014 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.866191 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.866326 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.866493 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.866626 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.866796 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.866930 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.867096 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.867222 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.867397 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.867526 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.867701 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.867835 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.868000 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.868126 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.868299 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.868427 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.868608 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.868733 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.868928 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.869063 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.869238 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.869367 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.869630 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.869753 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.869938 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.870062 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.870238 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.870368 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.870536 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.870670 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.870834 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.870973 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.871144 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.871277 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.871451 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.871577 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.871757 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.871892 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.872065 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.872198 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.872376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.872508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.872689 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.872824 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.872993 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.873120 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.873316 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.873444 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.873636 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.873773 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.873939 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.874070 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.874251 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.874374 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.874542 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.874666 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.874846 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.874985 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.875151 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.875278 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.875455 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.875583 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.875762 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.875886 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.876081 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.876207 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.876393 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.876528 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.876707 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.876826 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.877025 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.877296 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.877440 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.877632 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.877759 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.877947 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.878073 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.878263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.878390 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.878576 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.878722 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.878917 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.879041 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.879229 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.879356 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.879542 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.879668 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.879855 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.879987 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.880162 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.880296 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.880467 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.880592 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.880785 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.880911 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.881100 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.881246 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.881444 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.881570 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.881778 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.881997 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.882123 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.882314 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.882447 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.882629 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.882754 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.882943 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.883077 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.883257 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.883383 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.883569 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.883703 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.883882 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.884008 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.884195 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.884320 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.884507 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.884640 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.884820 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.884957 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.885130 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.885313 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.885467 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.885611 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.885778 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.885903 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.886088 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.886223 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.886399 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.886526 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.886708 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.886841 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.887019 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.887146 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.887328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.887462 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.887653 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.887778 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.887987 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.888116 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.888306 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.888441 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.888622 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.888748 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.888935 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.889135 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.889278 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.889400 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.889570 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.889770 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.889896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.890083 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.890211 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.890412 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.890538 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.890736 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.890875 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.891057 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.891183 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.891367 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.891490 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.891679 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.891816 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.891989 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.892121 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.892291 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.892417 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.892601 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.892736 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.892911 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.893037 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.893266 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.893414 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.893539 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.893670 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.893843 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.893969 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.894150 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.894462 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.894608 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.894742 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.894873 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.895074 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.895200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.895403 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.895664 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.895791 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.896014 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.896141 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.896327 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.896461 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.896650 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.896775 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.896959 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.897077 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.897285 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.897414 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.897595 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.897720 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.897902 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.898026 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.898204 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.898339 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.898507 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.898635 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.898820 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.898954 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.899125 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.899260 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.899425 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.899551 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.899729 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.899855 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.900038 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.900259 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.900386 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.900613 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.900740 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.900928 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.901051 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.901250 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.901390 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.901578 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.901704 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.901879 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.902015 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.902181 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.902306 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.902479 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.902613 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.902784 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.902926 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.903084 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.903210 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.903383 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.903509 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.903683 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.903818 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.903983 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.904109 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.904288 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.904489 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.904608 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.904798 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.904926 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.905106 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.905266 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.905435 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.905574 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.905744 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.905890 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.906046 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.906180 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.906487 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.906648 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.906774 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.906896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.907030 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.907153 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.907282 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.907414 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.907571 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.907706 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.907877 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.908003 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.908181 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.908314 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.908483 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.908608 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.908795 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.908920 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.909097 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.909268 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.909429 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.909553 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.909736 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.909876 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.910182 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.910309 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.910493 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.910634 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.910807 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.910934 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.911165 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.911293 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.911494 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.911619 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.911801 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.911936 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.912108 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.912237 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.912413 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.912552 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.912723 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.912856 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.913036 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.913161 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.913369 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.913496 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.913679 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.913816 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.913984 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.914107 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.914292 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.914420 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.914599 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.914850 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.914983 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.915187 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.915319 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.915489 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.915613 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.915791 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.915919 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.916097 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.916223 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.916403 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.916539 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.916709 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.916843 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.917018 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.917144 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.917367 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.917507 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.917678 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.917802 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.917989 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.918121 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.918297 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.918500 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.918626 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.918746 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.918901 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.919036 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.919203 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.919329 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.919510 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.919636 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.919813 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.919944 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.920121 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.920245 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.920425 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.920557 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.920734 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.920869 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.921034 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.921158 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.921362 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.921486 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.921678 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.921818 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.922018 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.922143 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.922338 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.922463 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.922660 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.922799 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.922976 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.923101 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.923291 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.923415 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.923596 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.923730 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.923905 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.924029 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.924209 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.924333 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.924515 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.924640 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.924831 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.924957 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.925168 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.925315 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.925509 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.925677 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.925886 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.926020 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.926251 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.926374 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.926559 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.926694 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.926872 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.927000 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.927188 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.927324 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.927496 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.927630 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.927795 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.927933 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.928099 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.928234 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.928407 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.928542 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.928712 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.928838 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.929011 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.929152 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.929323 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.929449 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.929628 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.929755 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.929937 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.930078 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.930237 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.930364 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.930540 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.930668 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.930842 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.930977 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.931144 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.931277 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.931446 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.931571 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.931745 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.931881 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.932049 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.932175 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.932348 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.932475 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.932646 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.932773 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.932943 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.933064 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.933303 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.933443 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.933614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.933749 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.933918 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.934043 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.934222 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.934363 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.934532 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.934659 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.934835 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.934959 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.935139 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.935279 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.935443 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.935568 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.935748 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.935882 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.936055 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.936189 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.936360 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.936487 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.936671 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.936797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.936978 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.937115 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.937304 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.937432 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.937610 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.937735 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.937917 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.938044 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.938583 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.938712 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.938920 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.939061 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.939196 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.939319 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.939501 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.939636 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.939822 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.939949 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.940147 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.940274 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.940453 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.940580 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.940762 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.940895 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.941078 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.941259 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.941446 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.941572 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.941760 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.941941 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.942074 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.942197 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.942379 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.942507 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.942687 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.942825 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.942992 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.943116 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.943300 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.943424 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.943603 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.943738 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.943910 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.944044 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.944218 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.944343 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.944530 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.944654 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.944851 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.944977 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.945154 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.945295 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.945502 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.945629 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.945814 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.945947 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.946143 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.946269 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.946460 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.946594 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.946771 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.946907 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.947100 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.947300 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.947437 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.947567 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.947689 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.947811 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.948002 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.948146 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.948301 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.948426 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.948549 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 07:11:32.948671 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.948907 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.949237 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.949571 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.949898 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.950209 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.950534 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.950863 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.951211 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.951523 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.951865 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.952192 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.952507 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.952820 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.953126 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:11:32.953391 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103283) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 07:11:33.009062 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO dbcounter [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Registered counter for database nova_api Jul 07 07:11:33.013743 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO dbcounter [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Registered counter for database nova_api Jul 07 07:11:33.124712 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG oslo_db.sqlalchemy.engines [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:11:33.128856 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_db.sqlalchemy.engines [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:11:33.131392 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writer thread running {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:11:33.135642 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writer thread running {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:11:33.186944 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.context [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c0cfef6-5327-469c-98b5-96dc22a57a03(cell1) {{(pid=103282) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 07:11:33.191374 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG oslo_concurrency.lockutils [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:11:33.191699 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.context [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c0cfef6-5327-469c-98b5-96dc22a57a03(cell1) {{(pid=103283) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 07:11:33.193041 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG oslo_concurrency.lockutils [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:11:33.193804 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG oslo_concurrency.lockutils [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:11:33.195695 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:11:33.195891 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG oslo_concurrency.lockutils [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:11:33.197358 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:11:33.197968 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO dbcounter [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Registered counter for database nova_cell0 Jul 07 07:11:33.198148 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:11:33.200286 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:11:33.201870 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO dbcounter [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Registered counter for database nova_cell1 Jul 07 07:11:33.202353 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO dbcounter [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Registered counter for database nova_cell0 Jul 07 07:11:33.209089 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO dbcounter [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Registered counter for database nova_cell1 Jul 07 07:11:33.210446 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG oslo_db.sqlalchemy.engines [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:11:33.211330 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG oslo_db.sqlalchemy.engines [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:11:33.213931 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_db.sqlalchemy.engines [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:11:33.218943 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writer thread running {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:11:33.219085 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writer thread running {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:11:33.219343 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writer thread running {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:11:33.219749 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_db.sqlalchemy.engines [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:11:33.359669 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writer thread running {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:11:33.365241 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO dbcounter [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Registered counter for database nova_cell0 Jul 07 07:11:33.368925 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO dbcounter [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Registered counter for database nova_cell0 Jul 07 07:11:33.375471 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG oslo_db.sqlalchemy.engines [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:11:33.376954 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_db.sqlalchemy.engines [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103283) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:11:33.380923 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writer thread running {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:11:33.382255 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writer thread running {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:11:33.724255 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: WARNING keystonemiddleware.auth_token [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 07:11:33.725025 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: WARNING keystonemiddleware.auth_token [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 07:11:33.731627 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: WARNING keystonemiddleware.auth_token [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 07:11:33.732106 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: WARNING keystonemiddleware.auth_token [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 07:11:34.070535 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: WARNING keystonemiddleware.auth_token [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 07:11:34.071217 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: WARNING keystonemiddleware.auth_token [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 07:11:34.076721 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: WARNING keystonemiddleware.auth_token [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 07:11:34.077463 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: WARNING keystonemiddleware.auth_token [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 07:11:34.082101 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5629e786f9c0 pid: 103282 (default app) Jul 07 07:11:34.082858 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5629e786f9c0 pid: 103283 (default app) Jul 07 07:11:34.084232 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:11:34.085486 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-bf1f9224-ddaf-4ab1-84d0-dbbff096a691 None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001794 Jul 07 07:11:34.085886 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Thu Jul 7 07:11:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:12:51.015297 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:12:51.017661 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003171 Jul 07 07:12:51.018374 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:12:51 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:12:51.043633 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_api:SELECT=3 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:51.046510 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_cell1:SELECT=3 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:51.047603 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_cell0:SELECT=3 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:51.048881 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:51.545320 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-ebe38ffa-f544-4c77-b0a0-c2b1d3dace70 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:12:51.581453 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-ebe38ffa-f544-4c77-b0a0-c2b1d3dace70 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.553596 Jul 07 07:12:51.593416 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 2/3] 10.222.0.62 () {60 vars in 1291 bytes} [Thu Jul 7 07:12:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:12:53.656212 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:12:53.657236 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-cdb56f1b-432a-425a-9a2a-3e030a35e014 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 07 07:12:53.658083 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 2/4] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:12:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:12:53.729829 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-52507392-bc45-4cce-8c27-500d07176c0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:12:53.748086 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:12:53.748086 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: warnings.warn(msg) Jul 07 07:12:53.780661 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-52507392-bc45-4cce-8c27-500d07176c0a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114924 Jul 07 07:12:53.782079 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 3/5] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Jul 7 07:12:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 07:12:53.796706 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writing DB stats nova_api:SELECT=3 {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:53.797813 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writing DB stats nova_cell0:SELECT=3 {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:53.798791 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writing DB stats nova_cell1:SELECT=3 {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:53.799599 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:12:54.006531 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-29ea6570-e533-41f4-9d54-db861414c18f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:12:54.009021 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:12:54.009021 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: warnings.warn(msg) Jul 07 07:12:54.085277 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-29ea6570-e533-41f4-9d54-db861414c18f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294537 Jul 07 07:12:54.085868 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 3/6] 10.222.0.62 () {64 vars in 1335 bytes} [Thu Jul 7 07:12:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:12:56.219537 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-52507392-bc45-4cce-8c27-500d07176c0a admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:12:56.220833 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-52507392-bc45-4cce-8c27-500d07176c0a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001927 Jul 07 07:12:56.221465 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 4/7] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:12:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:12:56.363079 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-b7b953e3-fea1-4834-9a64-c5c191a091bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "swap": 0}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:12:56.381988 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:12:56.381988 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: warnings.warn(msg) Jul 07 07:12:56.405842 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-b7b953e3-fea1-4834-9a64-c5c191a091bc admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.176421 Jul 07 07:12:56.406318 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 4/8] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Jul 7 07:12:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 07:12:56.419385 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-d669d500-81d6-45b3-9250-ef3bd96b79a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:12:56.420880 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:12:56.420880 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: warnings.warn(msg) Jul 07 07:12:56.455653 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-d669d500-81d6-45b3-9250-ef3bd96b79a0 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040030 Jul 07 07:12:56.456420 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 5/9] 10.222.0.62 () {64 vars in 1335 bytes} [Thu Jul 7 07:12:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:12:58.574576 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-b7b953e3-fea1-4834-9a64-c5c191a091bc admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:12:58.576257 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-b7b953e3-fea1-4834-9a64-c5c191a091bc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002197 Jul 07 07:12:58.576639 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:12:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:12:58.652136 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-d1e6e734-52d8-486a-9282-c7b26f48ef2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:12:58.673411 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-d1e6e734-52d8-486a-9282-c7b26f48ef2d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.090023 Jul 07 07:12:58.677562 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 6/11] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Jul 7 07:12:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 07:12:58.686597 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-53346d4d-0edc-47f9-8ec6-f3aede38f282 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:12:58.714079 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-53346d4d-0edc-47f9-8ec6-f3aede38f282 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031579 Jul 07 07:12:58.714669 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 6/12] 10.222.0.62 () {64 vars in 1335 bytes} [Thu Jul 7 07:12:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:13:00.867938 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-d1e6e734-52d8-486a-9282-c7b26f48ef2d admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:00.869645 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-d1e6e734-52d8-486a-9282-c7b26f48ef2d admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 07 07:13:00.869645 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 7/13] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:13:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:00.951803 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-15e7f879-09ef-496a-80c1-0d0592d97ddc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:00.971921 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-15e7f879-09ef-496a-80c1-0d0592d97ddc admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.096606 Jul 07 07:13:00.973900 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 7/14] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Jul 7 07:13:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:13:00.985577 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-f3429b76-e7e3-4410-aa8e-7d63fa32469d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:01.022643 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-f3429b76-e7e3-4410-aa8e-7d63fa32469d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041478 Jul 07 07:13:01.023246 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 8/15] 10.222.0.62 () {64 vars in 1335 bytes} [Thu Jul 7 07:13:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:13:03.199897 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-15e7f879-09ef-496a-80c1-0d0592d97ddc admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:03.201124 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-15e7f879-09ef-496a-80c1-0d0592d97ddc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001822 Jul 07 07:13:03.202263 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 8/16] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:13:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:13:03.299846 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-d4a73462-46f9-4baf-954a-21e66618f4f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "ram": 4096, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:03.321872 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-d4a73462-46f9-4baf-954a-21e66618f4f7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.112679 Jul 07 07:13:03.322648 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 9/17] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Jul 7 07:13:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 07:13:03.349125 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-91a74572-a5f7-40f7-a413-6d85dddb63b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:03.384609 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-91a74572-a5f7-40f7-a413-6d85dddb63b4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042541 Jul 07 07:13:03.385323 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 9/18] 10.222.0.62 () {64 vars in 1335 bytes} [Thu Jul 7 07:13:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:13:05.706081 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-d4a73462-46f9-4baf-954a-21e66618f4f7 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:05.707113 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-d4a73462-46f9-4baf-954a-21e66618f4f7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jul 07 07:13:05.707523 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 10/19] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:13:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:05.783019 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-ce4f97cc-fbd3-42c0-90ed-9007cad7d1f8 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:05.812199 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-ce4f97cc-fbd3-42c0-90ed-9007cad7d1f8 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.096444 Jul 07 07:13:05.813365 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 10/20] 10.222.0.62 () {60 vars in 1291 bytes} [Thu Jul 7 07:13:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:13:08.096074 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-d4a73462-46f9-4baf-954a-21e66618f4f7 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:08.100717 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-d4a73462-46f9-4baf-954a-21e66618f4f7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Jul 07 07:13:08.101709 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 11/21] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:13:08 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:13:08.195828 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-0db9239e-19e5-4bb1-89b6-6b39e43ba4d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "vcpus": 1, "id": "1", "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:08.227387 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-0db9239e-19e5-4bb1-89b6-6b39e43ba4d4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.122805 Jul 07 07:13:08.228634 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 11/22] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Jul 7 07:13:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 07:13:08.249839 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-1d12d1b8-54e9-4b03-b8ef-773d8e81d28d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:08.279499 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-1d12d1b8-54e9-4b03-b8ef-773d8e81d28d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035486 Jul 07 07:13:08.281570 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 12/23] 10.222.0.62 () {64 vars in 1332 bytes} [Thu Jul 7 07:13:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:13:11.066880 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-0db9239e-19e5-4bb1-89b6-6b39e43ba4d4 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:11.068254 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-0db9239e-19e5-4bb1-89b6-6b39e43ba4d4 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002053 Jul 07 07:13:11.068914 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 12/24] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:13:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:11.148263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-d0b88da9-1da9-46dc-a808-529401df174f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "2", "disk": 20, "swap": 0, "name": "m1.small", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:11.172843 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-d0b88da9-1da9-46dc-a808-529401df174f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.096795 Jul 07 07:13:11.176021 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 13/25] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Jul 7 07:13:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 07:13:11.199583 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-a2ce8da7-4faa-4bd4-9558-076a4900800c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:11.233847 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-a2ce8da7-4faa-4bd4-9558-076a4900800c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041636 Jul 07 07:13:11.234751 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 13/26] 10.222.0.62 () {64 vars in 1332 bytes} [Thu Jul 7 07:13:11 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:13:13.433125 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-d0b88da9-1da9-46dc-a808-529401df174f admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:13.434301 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-d0b88da9-1da9-46dc-a808-529401df174f admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001651 Jul 07 07:13:13.434815 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 14/27] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:13:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:13.523560 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-1b66af36-5fa3-4575-b2b4-48ef6d11665b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "vcpus": 2}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:13.544114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-1b66af36-5fa3-4575-b2b4-48ef6d11665b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.089582 Jul 07 07:13:13.544704 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 14/28] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Jul 7 07:13:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 07:13:13.562089 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-7417d825-656a-4c87-8b2a-3c156700b61a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:13.593406 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-7417d825-656a-4c87-8b2a-3c156700b61a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034331 Jul 07 07:13:13.596560 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 15/29] 10.222.0.62 () {64 vars in 1332 bytes} [Thu Jul 7 07:13:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:13:15.907352 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-1b66af36-5fa3-4575-b2b4-48ef6d11665b admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:15.908369 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-1b66af36-5fa3-4575-b2b4-48ef6d11665b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 07 07:13:15.908962 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 15/30] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:13:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:15.973969 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-c6d83efe-9a6e-433a-8e61-e8dd97847b4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:16.000667 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-c6d83efe-9a6e-433a-8e61-e8dd97847b4a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085407 Jul 07 07:13:16.001328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 16/31] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Jul 7 07:13:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 07:13:16.014524 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-fc9961e0-2d8a-4363-9cdb-24d485540a68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:16.047625 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-fc9961e0-2d8a-4363-9cdb-24d485540a68 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036864 Jul 07 07:13:16.048830 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 16/32] 10.222.0.62 () {64 vars in 1332 bytes} [Thu Jul 7 07:13:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:13:18.219338 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-c6d83efe-9a6e-433a-8e61-e8dd97847b4a admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:18.220352 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-c6d83efe-9a6e-433a-8e61-e8dd97847b4a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 07 07:13:18.222891 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 17/33] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:13:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:18.295994 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-0011fbea-1735-4c1f-ae8a-0379093ac4eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "ram": 16384, "id": "5", "vcpus": 8}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:18.319087 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-0011fbea-1735-4c1f-ae8a-0379093ac4eb admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.084420 Jul 07 07:13:18.319942 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 17/34] 10.222.0.62 () {64 vars in 1282 bytes} [Thu Jul 7 07:13:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:13:18.333207 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-5bd11fe5-e933-4019-9537-86ceafb086c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:18.357668 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-5bd11fe5-e933-4019-9537-86ceafb086c8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028196 Jul 07 07:13:18.358274 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 18/35] 10.222.0.62 () {64 vars in 1332 bytes} [Thu Jul 7 07:13:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:13:42.772731 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-0011fbea-1735-4c1f-ae8a-0379093ac4eb admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:42.774354 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-0011fbea-1735-4c1f-ae8a-0379093ac4eb admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002274 Jul 07 07:13:42.774952 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 18/36] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:13:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:42.788443 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:13:42.839627 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-6a9b9910-815a-4177-a7f4-6b631e1e1a09 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:42.857659 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-6a9b9910-815a-4177-a7f4-6b631e1e1a09 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073869 Jul 07 07:13:42.858216 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 19/37] 10.222.0.62 () {60 vars in 1291 bytes} [Thu Jul 7 07:13:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:13:43.797476 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-0011fbea-1735-4c1f-ae8a-0379093ac4eb admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:43.798545 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-0011fbea-1735-4c1f-ae8a-0379093ac4eb admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 07 07:13:43.798988 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 19/38] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:44.007352 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-5459b7b3-b219-4fd3-bbff-03391e566139 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:44.013326 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.wsgi [None req-5459b7b3-b219-4fd3-bbff-03391e566139 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-5459b7b3-b219-4fd3-bbff-03391e566139 admin admin] Request method failure captured: Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Accept: application/json Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Accept-Encoding: gzip, deflate Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Connection: keep-alive Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Content-Length: 0 Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Host: 10.222.0.62 Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Openstack-Api-Version: compute 2.90 Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Openstack-System-Scope: None Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: User-Agent: python-novaclient Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Auth-Token: gAAAAABixoenyFk7WfbTK2H4Zl4whWwatgNuuYZP0OEO4351clqneaa4jjOeJeUAEjnC2yN_GUKMFJPTwmurSc1Kkcgr8IpCghzL5J8QdUXit-9gbcgDSlK0bV4IZ_nNLCIuq8O8fnXgRu7VzYAj0EVlOXA9obG7Fp_8fI319wqGeH3VOuY69_Y Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Domain-Id: None Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Domain-Name: None Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Identity-Status: Confirmed Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Is-Admin-Project: True Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Domain-Id: default Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Domain-Name: Default Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Name: admin Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Role: member,admin,reader Jul 07 07:13:44.016569 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Roles: member,admin,reader Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Tenant: admin Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Tenant-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Tenant-Name: admin Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User: admin Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Domain-Id: default Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Domain-Name: Default Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Id: a3aabddbd41c4280b0867d9e10f45bdf Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Name: admin Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: method: > Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: exception: Flavor 42 could not be found. Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: action_args: {'id': '42'} Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:13:44.018200 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:44.020328 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:44.021797 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-5459b7b3-b219-4fd3-bbff-03391e566139 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:13:44.023136 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-5459b7b3-b219-4fd3-bbff-03391e566139 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.081188 Jul 07 07:13:44.023136 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 20/39] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Jul 7 07:13:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:44.028041 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-d9ced87b-895c-41e3-bbc3-d107f02be76d admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:44.031133 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:13:44.051284 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-d9ced87b-895c-41e3-bbc3-d107f02be76d admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026843 Jul 07 07:13:44.051835 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 20/40] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Jul 7 07:13:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:13:44.066837 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-01c4cebc-a44c-4fae-bfdb-30c9057cae1a admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:44.090063 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-01c4cebc-a44c-4fae-bfdb-30c9057cae1a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029195 Jul 07 07:13:44.090647 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 21/41] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Jul 7 07:13:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:13:44.103388 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-56354c55-0b14-4997-9ed0-fdd9823d9ec7 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:44.109612 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.wsgi [None req-56354c55-0b14-4997-9ed0-fdd9823d9ec7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-56354c55-0b14-4997-9ed0-fdd9823d9ec7 admin admin] Request method failure captured: Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Accept: application/json Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Accept-Encoding: gzip, deflate Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Connection: keep-alive Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Content-Length: 0 Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Host: 10.222.0.62 Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Openstack-Api-Version: compute 2.90 Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Openstack-System-Scope: None Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: User-Agent: python-novaclient Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Auth-Token: gAAAAABixoenyFk7WfbTK2H4Zl4whWwatgNuuYZP0OEO4351clqneaa4jjOeJeUAEjnC2yN_GUKMFJPTwmurSc1Kkcgr8IpCghzL5J8QdUXit-9gbcgDSlK0bV4IZ_nNLCIuq8O8fnXgRu7VzYAj0EVlOXA9obG7Fp_8fI319wqGeH3VOuY69_Y Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Domain-Id: None Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Domain-Name: None Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Identity-Status: Confirmed Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Is-Admin-Project: True Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Domain-Id: default Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Domain-Name: Default Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Name: admin Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Role: member,admin,reader Jul 07 07:13:44.112896 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Roles: member,admin,reader Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Tenant: admin Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Tenant-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Tenant-Name: admin Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User: admin Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Domain-Id: default Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Domain-Name: Default Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Id: a3aabddbd41c4280b0867d9e10f45bdf Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Name: admin Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: method: > Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: exception: Flavor 42 could not be found. Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: action_args: {'id': '42'} Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:13:44.114394 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:44.115350 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:44.116588 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-56354c55-0b14-4997-9ed0-fdd9823d9ec7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:13:44.117841 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-56354c55-0b14-4997-9ed0-fdd9823d9ec7 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015094 Jul 07 07:13:44.117841 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 21/42] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Jul 7 07:13:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:44.941181 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-01c4cebc-a44c-4fae-bfdb-30c9057cae1a admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:44.942261 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-01c4cebc-a44c-4fae-bfdb-30c9057cae1a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001582 Jul 07 07:13:44.942637 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 22/43] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:13:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:45.151628 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-cc03c59f-0249-480f-ba2c-48bc77c0a383 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:45.157184 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.wsgi [None req-cc03c59f-0249-480f-ba2c-48bc77c0a383 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-cc03c59f-0249-480f-ba2c-48bc77c0a383 admin admin] Request method failure captured: Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Accept: application/json Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Accept-Encoding: gzip, deflate Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Connection: keep-alive Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Content-Length: 0 Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Host: 10.222.0.62 Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Openstack-Api-Version: compute 2.90 Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Openstack-System-Scope: None Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: User-Agent: python-novaclient Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Auth-Token: gAAAAABixoeoPusuaA3PlUeGDExRH7VxNDOU0jl4Wz45mSvJmf31g-EQQSpYyPB_61b3WlCUFNwkM6PgEZkh7RSIcaPu_h5KzlvYDw7twUvjNYr8kenMrdkCKSO-Oe647RcK1NM7PbfNyhcxAQUuka0vwF-rKY8BBXaQaxmchIYR-PaNtoRu6w8 Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Domain-Id: None Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Domain-Name: None Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Identity-Status: Confirmed Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Is-Admin-Project: True Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Domain-Id: default Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Domain-Name: Default Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Name: admin Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Role: member,admin,reader Jul 07 07:13:45.158756 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Roles: member,admin,reader Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Tenant: admin Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Tenant-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Tenant-Name: admin Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User: admin Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Domain-Id: default Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Domain-Name: Default Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Id: a3aabddbd41c4280b0867d9e10f45bdf Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Name: admin Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: method: > Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: exception: Flavor 84 could not be found. Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: action_args: {'id': '84'} Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:13:45.160174 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:45.161114 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:45.162376 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-cc03c59f-0249-480f-ba2c-48bc77c0a383 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:13:45.163632 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-cc03c59f-0249-480f-ba2c-48bc77c0a383 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.082448 Jul 07 07:13:45.163632 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 22/44] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Jul 7 07:13:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:45.172151 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-0b494a56-6878-488d-9307-a1b9e16b0ce4 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:45.189914 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-0b494a56-6878-488d-9307-a1b9e16b0ce4 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022841 Jul 07 07:13:45.190453 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 23/45] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Jul 7 07:13:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:13:45.202150 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-5678b2b1-ba3e-4d2b-9961-d28e310ab0c0 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:45.216317 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-5678b2b1-ba3e-4d2b-9961-d28e310ab0c0 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017733 Jul 07 07:13:45.216833 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 23/46] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Jul 7 07:13:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:13:45.226399 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-85b37042-de1f-44cb-86e5-f7ecc8651999 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:45.232286 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.wsgi [None req-85b37042-de1f-44cb-86e5-f7ecc8651999 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-85b37042-de1f-44cb-86e5-f7ecc8651999 admin admin] Request method failure captured: Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Accept: application/json Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Accept-Encoding: gzip, deflate Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Connection: keep-alive Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Content-Length: 0 Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Host: 10.222.0.62 Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Openstack-Api-Version: compute 2.90 Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Openstack-System-Scope: None Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: User-Agent: python-novaclient Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Auth-Token: gAAAAABixoeoPusuaA3PlUeGDExRH7VxNDOU0jl4Wz45mSvJmf31g-EQQSpYyPB_61b3WlCUFNwkM6PgEZkh7RSIcaPu_h5KzlvYDw7twUvjNYr8kenMrdkCKSO-Oe647RcK1NM7PbfNyhcxAQUuka0vwF-rKY8BBXaQaxmchIYR-PaNtoRu6w8 Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Domain-Id: None Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Domain-Name: None Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Identity-Status: Confirmed Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Is-Admin-Project: True Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Domain-Id: default Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Domain-Name: Default Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Name: admin Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Role: member,admin,reader Jul 07 07:13:45.233840 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Roles: member,admin,reader Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Tenant: admin Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Tenant-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Tenant-Name: admin Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User: admin Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Domain-Id: default Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Domain-Name: Default Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Id: a3aabddbd41c4280b0867d9e10f45bdf Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Name: admin Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: method: > Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: exception: Flavor 84 could not be found. Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: action_args: {'id': '84'} Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:13:45.235263 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:45.236206 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:45.237508 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-85b37042-de1f-44cb-86e5-f7ecc8651999 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:13:45.238747 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-85b37042-de1f-44cb-86e5-f7ecc8651999 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012442 Jul 07 07:13:45.238747 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 24/47] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Jul 7 07:13:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:46.085244 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-5678b2b1-ba3e-4d2b-9961-d28e310ab0c0 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:46.086260 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-5678b2b1-ba3e-4d2b-9961-d28e310ab0c0 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 07 07:13:46.086682 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 24/48] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:13:46.293097 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8ecc9259-14a0-42ca-9ec7-a123acf60ede admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:46.299085 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.wsgi [None req-8ecc9259-14a0-42ca-9ec7-a123acf60ede admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8ecc9259-14a0-42ca-9ec7-a123acf60ede admin admin] Request method failure captured: Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Accept: application/json Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Accept-Encoding: gzip, deflate Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Connection: keep-alive Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Content-Length: 0 Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Host: 10.222.0.62 Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Openstack-Api-Version: compute 2.90 Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Openstack-System-Scope: None Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: User-Agent: python-novaclient Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Auth-Token: gAAAAABixoeqx_rz0UD_DdVsKUm0TbddBmvBHZYYSJEwNGzT45ShEAJsE9NGPxkmIKU-w4NgUz8mrwm1Ea1G0iPqU7gWNRm2Gi3c1-yX-_gUYQrFvc7sXxpFDeqYhOaldaWfkyMhSEZkAsBFyFa8BZO-U9XzexwmBnGxB_41EEgP05ucDnOfg7k Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Domain-Id: None Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Domain-Name: None Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Identity-Status: Confirmed Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Is-Admin-Project: True Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Domain-Id: default Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Domain-Name: Default Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Project-Name: admin Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Role: member,admin,reader Jul 07 07:13:46.300591 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Roles: member,admin,reader Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Tenant: admin Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Tenant-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-Tenant-Name: admin Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User: admin Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Domain-Id: default Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Domain-Name: Default Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Id: a3aabddbd41c4280b0867d9e10f45bdf Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: X-User-Name: admin Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: method: > Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: exception: Flavor 451 could not be found. Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: action_args: {'id': '451'} Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:13:46.302053 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:46.303109 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jul 07 07:13:46.304715 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8ecc9259-14a0-42ca-9ec7-a123acf60ede admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:13:46.306315 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8ecc9259-14a0-42ca-9ec7-a123acf60ede admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.073994 Jul 07 07:13:46.306315 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 25/49] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Jul 7 07:13:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:46.316169 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-a5cc5825-cac8-470b-a2ee-d6efb420a36c admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:46.334812 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-a5cc5825-cac8-470b-a2ee-d6efb420a36c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024812 Jul 07 07:13:46.335519 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 25/50] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Jul 7 07:13:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:13:46.345618 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:46.360779 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018764 Jul 07 07:13:46.361346 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 26/51] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Jul 7 07:13:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:13:46.371216 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-44d09f5d-9596-4038-ad17-4d79a5aa68bb admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:46.377021 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.wsgi [None req-44d09f5d-9596-4038-ad17-4d79a5aa68bb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-44d09f5d-9596-4038-ad17-4d79a5aa68bb admin admin] Request method failure captured: Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Accept: application/json Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Accept-Encoding: gzip, deflate Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Connection: keep-alive Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Content-Length: 0 Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Host: 10.222.0.62 Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Openstack-Api-Version: compute 2.90 Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Openstack-System-Scope: None Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: User-Agent: python-novaclient Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Auth-Token: gAAAAABixoeqx_rz0UD_DdVsKUm0TbddBmvBHZYYSJEwNGzT45ShEAJsE9NGPxkmIKU-w4NgUz8mrwm1Ea1G0iPqU7gWNRm2Gi3c1-yX-_gUYQrFvc7sXxpFDeqYhOaldaWfkyMhSEZkAsBFyFa8BZO-U9XzexwmBnGxB_41EEgP05ucDnOfg7k Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Domain-Id: None Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Domain-Name: None Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Identity-Status: Confirmed Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Is-Admin-Project: True Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Openstack-Nova-Api-Version: 2.90 Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Domain-Id: default Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Domain-Name: Default Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Project-Name: admin Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Role: member,admin,reader Jul 07 07:13:46.378614 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Roles: member,admin,reader Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b5d565ccc8d74ff1978b89c064272f84"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Tenant: admin Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Tenant-Id: b5d565ccc8d74ff1978b89c064272f84 Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-Tenant-Name: admin Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User: admin Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Domain-Id: default Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Domain-Name: Default Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Id: a3aabddbd41c4280b0867d9e10f45bdf Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: X-User-Name: admin Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: method: > Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: exception: Flavor 451 could not be found. Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: action_args: {'id': '451'} Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:13:46.380113 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:46.381059 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: ERROR nova.api.openstack.wsgi Jul 07 07:13:46.382389 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-44d09f5d-9596-4038-ad17-4d79a5aa68bb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103283) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:13:46.383917 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-44d09f5d-9596-4038-ad17-4d79a5aa68bb admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012508 Jul 07 07:13:46.384336 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 26/52] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Jul 7 07:13:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 07 07:13:47.206574 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:47.207592 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 07 07:13:47.208021 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 27/53] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:13:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:47.408773 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-4724b2ed-1355-4dcd-9c1b-00cc556790c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:47.429578 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-4724b2ed-1355-4dcd-9c1b-00cc556790c2 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.081808 Jul 07 07:13:47.430021 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 27/54] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Jul 7 07:13:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:13:48.273201 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:48.274630 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002302 Jul 07 07:13:48.275026 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 28/55] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:13:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:48.466842 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-1a456801-d3df-4532-91a6-496ffc74feee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:48.486254 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-1a456801-d3df-4532-91a6-496ffc74feee admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.075431 Jul 07 07:13:48.486778 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 28/56] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Jul 7 07:13:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:13:49.309950 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:49.310969 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jul 07 07:13:49.311383 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 29/57] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:13:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:49.510924 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-1ce4bcd1-67e6-4d98-a2a8-8bd046ebcec5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:49.532404 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-1ce4bcd1-67e6-4d98-a2a8-8bd046ebcec5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.083611 Jul 07 07:13:49.532885 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 29/58] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Jul 7 07:13:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:13:50.394128 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:50.395149 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 07 07:13:50.395546 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 30/59] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:13:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:50.587846 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-840a7932-ef83-4ace-a6b4-4633d33dfec5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:13:50.610075 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-840a7932-ef83-4ace-a6b4-4633d33dfec5 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.078691 Jul 07 07:13:50.610556 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 30/60] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Jul 7 07:13:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:13:51.449610 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:51.450654 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 07 07:13:51.451184 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 31/61] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:13:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:13:51.670218 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-e61e8ad0-4729-4f7e-8a98-2f11fd555c96 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:13:51.691727 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-e61e8ad0-4729-4f7e-8a98-2f11fd555c96 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.091374 Jul 07 07:13:51.692263 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 31/62] 10.222.0.62 () {60 vars in 1202 bytes} [Thu Jul 7 07:13:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:14:39.296077 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:14:39.297102 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8798a1b2-ceb9-48f3-a656-c931e6562a87 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 07 07:14:39.297778 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 32/63] 10.222.0.62 () {54 vars in 930 bytes} [Thu Jul 7 07:14:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:14:39.309430 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:14:39.370578 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-76bc05ad-8756-4b2f-a811-98e841a09290 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:14:39.389956 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-76bc05ad-8756-4b2f-a811-98e841a09290 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.085607 Jul 07 07:14:39.390717 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 32/64] 10.222.0.62 () {60 vars in 1291 bytes} [Thu Jul 7 07:14:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:14:39.413554 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-e20361fd-7a74-4b89-bbb4-2b4ba758b5f5 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:14:39.417130 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_api:SELECT=14 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:14:39.422856 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-e20361fd-7a74-4b89-bbb4-2b4ba758b5f5 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012944 Jul 07 07:14:39.423378 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 33/65] 10.222.0.62 () {60 vars in 1282 bytes} [Thu Jul 7 07:14:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:14:39.441582 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-6c63a384-78a8-4530-a856-c476137e8f56 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:14:39.451224 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-6c63a384-78a8-4530-a856-c476137e8f56 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015801 Jul 07 07:14:39.451749 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 33/66] 10.222.0.62 () {60 vars in 1285 bytes} [Thu Jul 7 07:14:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:14:39.463804 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8e94b550-4868-4249-af3b-3a139636cb26 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:14:39.471891 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8e94b550-4868-4249-af3b-3a139636cb26 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011961 Jul 07 07:14:39.472335 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 34/67] 10.222.0.62 () {60 vars in 1285 bytes} [Thu Jul 7 07:14:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:14:39.484256 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-7f08d0f2-08b7-4319-8be8-fa527c761dc3 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:14:39.492466 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-7f08d0f2-08b7-4319-8be8-fa527c761dc3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011822 Jul 07 07:14:39.493179 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 34/68] 10.222.0.62 () {60 vars in 1282 bytes} [Thu Jul 7 07:14:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:18:05.218322 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8e94b550-4868-4249-af3b-3a139636cb26 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:18:05.220620 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8e94b550-4868-4249-af3b-3a139636cb26 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 07 07:18:05.220620 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 35/69] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:18:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:18:05.364569 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writing DB stats nova_api:SELECT=6 {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:18:05.489612 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-81fc5877-5e53-44d3-a217-f0a88f52a41b admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:18:05.490790 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:18:05.490790 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: warnings.warn(msg) Jul 07 07:18:05.492035 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-81fc5877-5e53-44d3-a217-f0a88f52a41b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:18:05.492479 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-81fc5877-5e53-44d3-a217-f0a88f52a41b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:18:05.493301 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-81fc5877-5e53-44d3-a217-f0a88f52a41b admin admin] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:18:05.493732 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-81fc5877-5e53-44d3-a217-f0a88f52a41b admin admin] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:18:05.527997 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-81fc5877-5e53-44d3-a217-f0a88f52a41b admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.164960 Jul 07 07:18:05.528546 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 35/70] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Jul 7 07:18:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:18:06.365865 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8e94b550-4868-4249-af3b-3a139636cb26 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:18:06.366879 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8e94b550-4868-4249-af3b-3a139636cb26 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 07 07:18:06.367276 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 36/71] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:18:06.560558 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-97ad983e-3a9e-468e-a4b8-e51444fc33a9 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:18:06.562220 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:18:06.562220 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: warnings.warn(msg) Jul 07 07:18:06.563466 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-97ad983e-3a9e-468e-a4b8-e51444fc33a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:18:06.563899 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-97ad983e-3a9e-468e-a4b8-e51444fc33a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:18:06.565170 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-97ad983e-3a9e-468e-a4b8-e51444fc33a9 admin admin] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:18:06.565640 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-97ad983e-3a9e-468e-a4b8-e51444fc33a9 admin admin] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:18:06.587679 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-97ad983e-3a9e-468e-a4b8-e51444fc33a9 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083882 Jul 07 07:18:06.588277 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 36/72] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Jul 7 07:18:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:18:17.853491 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8e94b550-4868-4249-af3b-3a139636cb26 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:18:17.854600 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8e94b550-4868-4249-af3b-3a139636cb26 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 07 07:18:17.855019 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 37/73] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:18:17.996519 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writing DB stats nova_cell0:SELECT=4 {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:18:17.997158 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writing DB stats nova_cell1:SELECT=4 {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:18:17.997788 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG dbcounter [-] [103283] Writing DB stats nova_api:SELECT=8 {{(pid=103283) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:18:18.051725 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-d2b1e6ed-5004-4795-b153-feb143ea70c8 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:18:18.052897 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:18:18.052897 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: warnings.warn(msg) Jul 07 07:18:18.054153 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-d2b1e6ed-5004-4795-b153-feb143ea70c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:18:18.054586 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-d2b1e6ed-5004-4795-b153-feb143ea70c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:18:18.055369 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-d2b1e6ed-5004-4795-b153-feb143ea70c8 admin admin] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:18:18.055794 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-d2b1e6ed-5004-4795-b153-feb143ea70c8 admin admin] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:18:18.080625 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-d2b1e6ed-5004-4795-b153-feb143ea70c8 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088628 Jul 07 07:18:18.081168 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 37/74] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Jul 7 07:18:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:18:18.944085 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8e94b550-4868-4249-af3b-3a139636cb26 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:18:18.945212 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8e94b550-4868-4249-af3b-3a139636cb26 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jul 07 07:18:18.945639 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 38/75] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Jul 7 07:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:18:19.145750 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG nova.api.openstack.wsgi [None req-91679f68-8e0c-4cb4-90eb-44e0898660f3 admin admin] Calling method '>' {{(pid=103283) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:18:19.147076 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 07:18:19.147076 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: warnings.warn(msg) Jul 07 07:18:19.148527 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-91679f68-8e0c-4cb4-90eb-44e0898660f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:18:19.149010 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-91679f68-8e0c-4cb4-90eb-44e0898660f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:18:19.150348 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-91679f68-8e0c-4cb4-90eb-44e0898660f3 admin admin] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:18:19.150931 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: DEBUG oslo_concurrency.lockutils [None req-91679f68-8e0c-4cb4-90eb-44e0898660f3 admin admin] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103283) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:18:19.175087 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: INFO nova.api.openstack.requestlog [None req-91679f68-8e0c-4cb4-90eb-44e0898660f3 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092040 Jul 07 07:18:19.175706 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: [pid: 103283|app: 0|req: 38/76] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Jul 7 07:18:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:19:15.982840 dv-cinder-826608-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 07 07:19:15.983381 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: Thu Jul 7 07:19:15 2022 - graceful shutdown triggered... Jul 07 07:19:15.983822 dv-cinder-826608-5-iscsi devstack@n-api.service[103282]: Gracefully killing worker 1 (pid: 103282)... Jul 07 07:19:15.984581 dv-cinder-826608-5-iscsi devstack@n-api.service[103283]: Gracefully killing worker 2 (pid: 103283)... Jul 07 07:19:16.984382 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: worker 1 buried after 1 seconds Jul 07 07:19:16.984382 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: worker 2 buried after 1 seconds Jul 07 07:19:16.984382 dv-cinder-826608-5-iscsi devstack@n-api.service[103281]: goodbye to uWSGI. Jul 07 07:19:16.986077 dv-cinder-826608-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 07 07:19:16.986659 dv-cinder-826608-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 07 07:19:16.989538 dv-cinder-826608-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 07 07:19:16.999468 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 07 07:19:17.001665 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 7 07:19:16 2022] *** Jul 07 07:19:17.001665 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 07 07:19:17.001665 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 07 07:19:17.001665 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: nodename: dv-cinder-826608-5-iscsi Jul 07 07:19:17.001665 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: machine: x86_64 Jul 07 07:19:17.001665 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: clock source: unix Jul 07 07:19:17.001665 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: pcre jit disabled Jul 07 07:19:17.001665 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: detected number of CPU cores: 4 Jul 07 07:19:17.001665 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: current working directory: / Jul 07 07:19:17.001665 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: detected binary path: /usr/bin/uwsgi-core Jul 07 07:19:17.002316 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: your processes number limit is 47680 Jul 07 07:19:17.002316 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: your memory page size is 4096 bytes Jul 07 07:19:17.002316 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: detected max file descriptor number: 2048 Jul 07 07:19:17.002316 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: lock engine: pthread robust mutexes Jul 07 07:19:17.002316 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: thunder lock: enabled Jul 07 07:19:17.002316 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 07 07:19:17.002316 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 07 07:19:17.046967 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: Python main interpreter initialized at 0x557a4d6179c0 Jul 07 07:19:17.046967 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: python threads support enabled Jul 07 07:19:17.046967 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: your server socket listen backlog is limited to 100 connections Jul 07 07:19:17.046967 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: your mercy for graceful operations on workers is 90 seconds Jul 07 07:19:17.047449 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: mapped 403077 bytes (393 KB) for 2 cores Jul 07 07:19:17.047449 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: *** Operational MODE: preforking *** Jul 07 07:19:17.047705 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: *** uWSGI is running in multiple interpreter mode *** Jul 07 07:19:17.047705 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: spawned uWSGI master process (pid: 117765) Jul 07 07:19:17.047954 dv-cinder-826608-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 07 07:19:17.048838 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: spawned uWSGI worker 1 (pid: 117787, cores: 1) Jul 07 07:19:17.048974 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: spawned uWSGI worker 2 (pid: 117788, cores: 1) Jul 07 07:19:17.049065 dv-cinder-826608-5-iscsi devstack@n-api.service[117765]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 07 07:19:17.712840 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 07:19:17.713391 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 07 07:19:18.896834 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:19:18.896834 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: from cryptography.utils import int_from_bytes Jul 07 07:19:18.897515 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:19:18.897515 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: from cryptography.utils import int_from_bytes Jul 07 07:19:18.900445 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:19:18.900445 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: from cryptography.utils import int_from_bytes Jul 07 07:19:18.900929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 07:19:18.900929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: from cryptography.utils import int_from_bytes Jul 07 07:19:21.231916 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 07:19:21.232798 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 07:19:21.232798 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 07:19:21.233108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 07:19:21.233601 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 07:19:21.233985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.234315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.234658 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.234994 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.235325 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.235638 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.235965 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.236287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.236617 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.236879 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.237196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.237568 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-5-iscsi {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.237668 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 07:19:21.238022 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.238105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 07:19:21.238198 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.238446 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 07:19:21.238563 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.238784 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.238892 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 07:19:21.239065 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 07:19:21.239170 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.239395 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.239517 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.239711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.239869 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.240069 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.240246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.240439 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.241075 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.241373 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.241763 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.242036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.242332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.242579 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.242787 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.243004 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.243221 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.243467 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.243467 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.243947 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.243947 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.244368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.244583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-5-iscsi {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.244799 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.245021 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.245242 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.245447 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.245674 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.245879 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.245879 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.246287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-5-iscsi {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.246516 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.246721 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.246938 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.247132 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.247306 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.247513 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.247661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.247892 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.248114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.248277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.248432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.248617 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.248765 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.248915 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.249076 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.249248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.249413 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.249588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.249779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.249955 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.250156 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.250337 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.250486 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.251606 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.251772 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.251963 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.252126 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.252271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.252271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.252603 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-5-iscsi {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.252806 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.252968 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.253119 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.253292 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.253763 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.253924 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.254079 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.254232 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.254382 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.254535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.254677 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.254677 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.254960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.255112 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.255275 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.255421 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.255577 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.255727 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.255931 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.256081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.256234 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.256387 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.256542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.256697 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.256854 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.256999 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.257149 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.257407 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.257571 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.257725 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.257887 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.258038 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.258189 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.258332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.258481 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.258634 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.258787 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.258938 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.259088 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.259241 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.259395 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.259547 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.259748 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.259904 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.260064 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.260211 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.260361 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.260522 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.260673 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.260930 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.261630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.261821 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.262053 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.262208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.262365 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.262509 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.262650 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.262801 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.262959 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.263113 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.263264 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.263419 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.263570 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.263740 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.264010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.264170 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.264315 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.264477 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.264636 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.264788 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.264938 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.265091 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.265278 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.265444 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.265633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.265839 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.266026 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.266217 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.266421 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.266647 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.266877 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.267097 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.267325 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.267545 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.267828 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.268056 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.268294 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.268482 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.268683 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.268860 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.269070 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.269301 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.269554 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.269767 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.269767 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.270239 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.270476 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.270712 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.271097 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.272174 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.272408 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.272642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.272868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.273108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.273398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.273670 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.273913 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.274211 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.274368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.274522 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.274677 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.274821 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.274964 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.275117 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.275261 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.275418 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.275564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.275707 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.275914 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.276070 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.276222 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.276379 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.276532 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.276685 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.276846 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.276997 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.277148 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.277328 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.277473 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.277617 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.277776 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.277931 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.278116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.278116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.278116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.278116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.278667 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.278810 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.278952 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.279102 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.279245 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.279605 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.279782 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.279990 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.280179 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.280327 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.280471 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.280625 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.280770 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.280935 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.281109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.281395 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.281395 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.283045 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.283199 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.283374 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.283544 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.283723 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.283943 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.284104 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.284423 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.284582 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.284756 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.284912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.285071 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.285291 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.285456 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.285600 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.285757 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.285929 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.286083 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.286277 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.286432 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.286586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.286729 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.286873 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.287025 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.287173 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.287323 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.287480 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.287480 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.287761 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.287920 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.288065 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.288251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.288415 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.288562 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.288719 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.288719 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.288719 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.289150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.289328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.289328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.289619 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.289780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.289780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.290079 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.290232 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.290382 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.290534 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.290534 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.290804 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.290959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.291104 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.291254 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.291254 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.291706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.292696 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.292872 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.293017 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.293017 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.293366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.293522 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.293674 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.293835 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.293835 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.294121 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.294292 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.294466 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.294775 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.294775 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.295111 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.295264 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.295264 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.295564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.295717 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.295950 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 07:19:21.296107 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.296107 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.296391 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.296536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.296536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.296828 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.296987 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.297141 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.297317 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.297317 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.297605 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.297763 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.297763 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.298035 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.298186 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.298186 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.298464 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.298617 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.298617 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.298913 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.299055 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.299208 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.299359 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.299514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.299665 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.299809 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.300015 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.300179 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.300358 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.300531 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.300680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.300841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.300986 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.300986 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.301320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.301470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.301753 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.301924 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.302730 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.302889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.303049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.303193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.303344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.303495 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.303495 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.303797 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.303941 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.304083 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.304233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.304233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.304551 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.304711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.304979 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.305128 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.305128 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.305429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.305594 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.305748 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.305904 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.306047 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.306188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.306330 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.306487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.306658 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.306832 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.306998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.307152 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.307295 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.307446 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.307446 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.307737 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.307887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.308033 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.308190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.308342 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.308492 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.308643 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.308812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.308958 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.309101 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.309306 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.309456 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.309617 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.309761 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.309914 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.310078 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.310078 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.310369 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.310369 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.310716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.310875 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.311036 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.311189 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.311360 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.311360 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.311661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.311661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.312108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.312918 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.313093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.313291 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.313456 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.313601 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.314119 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.314293 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.314449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.314449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.314742 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.314902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.315190 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.315318 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.315509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.315662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.315823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.315985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.316183 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.316328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.316495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.316641 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.316791 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.316966 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.317140 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.317410 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.317410 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.317410 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.317877 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.318029 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.318188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.318387 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.318565 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.318727 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.318872 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.319023 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.319184 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.319336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.319526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.319672 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.319672 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.319978 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.320122 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.320272 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.320424 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.320424 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.320743 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.320898 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.321049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.321049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.321368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.321368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.321651 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.322155 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.322321 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.323322 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.323490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.323659 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.323817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.323961 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.324112 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.324267 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.324267 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.324594 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.324748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.324902 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.325062 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.325277 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.325615 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.325615 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.325921 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.326100 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.326274 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.326428 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.326626 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.326857 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.327006 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.327149 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.327299 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.327449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.327600 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.327778 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.327778 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.328208 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.328360 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.328543 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.328704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.328875 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.329035 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.329187 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.329370 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.329522 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.329674 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.329827 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.329970 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.330113 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.330255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.330255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.330539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.330714 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.330877 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.331020 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.331166 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.331308 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.331459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.331603 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.331753 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.331896 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.332045 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.332336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.332499 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.332661 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.333548 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.333728 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.333874 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.334028 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.334173 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.334317 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.334459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.334604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.334604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.334940 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.335089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.335089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.335089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.335513 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.335781 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.335944 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.336089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.336089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.336370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.336529 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.336672 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.336823 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.336967 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.337117 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.337308 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.337461 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.337631 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.337783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.337783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.338071 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.338290 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.338448 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.338601 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.338745 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.338887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.339062 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.339204 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.339354 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.339516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.339685 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.339832 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.339988 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.340139 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.340281 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.340432 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.340575 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.340716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.340858 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.341000 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.341000 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.341340 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.341436 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.341561 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.341689 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.341871 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.342021 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.342151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.342294 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.342513 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.342653 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.342781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.342918 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.343340 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.343711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.343855 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.343993 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.344123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.344260 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.344388 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.344515 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.344515 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.344756 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.344883 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.345024 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.345153 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.345296 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.345415 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.345542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.345682 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.346640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.346804 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.346945 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.347082 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.347219 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.347386 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.347630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.347762 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.347900 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.348029 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.348158 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.348310 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.348514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.348644 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.348771 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.348900 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.349028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.349028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.349301 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.349432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.349572 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.349572 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.349837 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.349967 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.349967 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.350216 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.350345 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.350345 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.350593 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.350729 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.350858 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.351088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.351088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.351394 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.351524 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.351754 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.351895 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.351895 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.352150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.352278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.352278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.352543 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.352750 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.352897 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.353027 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.353179 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.353593 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.353970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.354098 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.354098 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.354363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.354491 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.354491 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.354735 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.354863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.354863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.355118 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.355255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.355395 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.355521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.355521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.355846 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.355973 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.356106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.356234 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.356234 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.356497 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.356624 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.356624 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.357014 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.357152 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.357298 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.357478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.357478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.357740 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.357868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.357996 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.358131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.358131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.358383 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.358525 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.358730 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.358869 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.358869 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.359135 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.359262 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.359389 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.359554 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.359554 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.359812 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.359948 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.359948 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.360190 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.360325 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.360325 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.360590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.360732 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.360862 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.360990 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.360990 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.361281 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.361412 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.361542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.361662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.361662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.361916 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.362056 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.362056 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.362307 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.362444 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.362573 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.362700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.362700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.363335 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.363718 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.363718 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.364235 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.364364 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.364502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.364632 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.364632 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.364890 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.365028 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.365028 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.365304 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.365445 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.365583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.365720 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.365720 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.365988 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.366125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.366125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.366374 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.366511 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.366655 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.366873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.367103 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.367250 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.367250 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.367502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.367662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.367800 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.367936 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.368072 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.368208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.368208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.368457 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.368584 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.368584 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.368932 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.369074 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.369212 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.369417 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.369417 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.369681 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.369827 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.369827 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.370078 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.370214 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.370343 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.370470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.370470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.370728 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.370865 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.370865 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.370865 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.371242 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.371379 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.371379 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.371735 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.371873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.371873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.372117 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.372246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.372375 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.372511 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.372511 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.372762 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.372905 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.373166 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.373315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.373461 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.373843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.373843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.374337 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.374471 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.374471 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.374733 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.374871 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.375014 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.375159 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.375159 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.375401 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.375529 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.375688 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.375827 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.375965 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.376101 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.376101 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.376353 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.376490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.376490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.376743 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.376879 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.377016 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.377267 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.377267 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.377539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.377721 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.377721 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.377966 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.378095 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.378095 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.378349 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.378477 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.378604 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.378731 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.378858 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.379071 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.379213 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.379390 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.379524 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.379755 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.379888 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.380066 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.380269 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.380402 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.380666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.380795 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.380991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.381158 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.381331 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.381614 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.381745 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.381926 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.382085 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.382226 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.382506 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.382643 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.382815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.382971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.383256 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.383406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.383564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.383957 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.384101 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.384449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.384605 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.384755 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.384893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.385030 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.385030 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.385373 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.385520 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.385733 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.385864 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.386099 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.386232 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.386410 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.386555 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.386723 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.387000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.387132 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.387366 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.387504 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.387643 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.387918 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.388244 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.388551 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.388882 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.389193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.389546 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.389853 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.390173 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.390621 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.390958 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.391267 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.391687 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.392541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.392541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.392821 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.392967 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.393404 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.393573 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.394191 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.394191 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.394843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.394843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.395101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.395259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.395438 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.395580 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.395737 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.396019 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.396156 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.396469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.396619 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.396894 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.397030 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.397279 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.397462 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.397804 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.397952 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.398227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.398363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.398637 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.398772 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.398969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.399279 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.399434 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.399645 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.399837 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.400064 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.400206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.400402 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.400544 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.400715 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.400990 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.401142 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.401461 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.405274 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.405478 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.405567 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.405643 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.405716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.405788 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.405788 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.405937 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406018 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406099 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406179 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406339 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406411 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406491 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406571 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406643 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406727 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406807 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.406966 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407046 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407118 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407201 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407281 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407360 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407433 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407580 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407664 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407742 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407820 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407820 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407820 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.407820 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.408090 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.408162 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.408408 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.408709 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.408897 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.409072 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.409313 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.409624 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.409799 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.410141 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.410775 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.410879 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.410975 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411063 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411148 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411243 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411342 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411437 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411437 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411596 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411689 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411778 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.411962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.412101 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.412195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.412408 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.412514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.412712 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.412805 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.413023 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.413123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.413358 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.413470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.413666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.413766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.413973 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.414067 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.414282 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.414388 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.414587 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.414686 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.414912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.415012 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.415221 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.415326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.415526 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.415621 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.415851 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.415943 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.416133 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.416235 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.416476 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.416568 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.416780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.416879 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.417119 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.417277 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.417470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.417627 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.417870 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.417963 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.418112 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.418206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.418429 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.418537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.418746 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.418842 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.419055 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.419160 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.419372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.419467 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.419684 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.419780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.420029 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.420132 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.420337 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.420440 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.420653 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.420774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.420961 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.421064 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.421292 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.421405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.421611 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.421713 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.421924 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.422033 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.422245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.422353 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.422570 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.422820 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.422913 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.423153 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.423245 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.423469 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.423572 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.423780 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.423879 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.424094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.424186 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.424406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.424506 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.424720 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.424812 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.425034 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.425133 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.425370 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.425479 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.425685 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.425791 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.425996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.426101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.426304 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.426404 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.426617 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.426718 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.426930 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.427033 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.427240 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.427351 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.428218 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.428336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.428422 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.428524 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.428602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.428602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.429014 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.429372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.429748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.430121 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.430407 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.430820 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.430961 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.431324 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.431661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.432136 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.432473 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.432813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.433153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.433516 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.433841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.434169 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.434495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.434594 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.434809 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.434911 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.435227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.435321 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.435597 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.435713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.435955 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.436058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.436271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.436372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.436585 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.436685 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.436898 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.437005 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.437248 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.437369 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.437760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.437868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.437996 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.438130 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.438214 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.438287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.438468 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.438601 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.439124 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.439281 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.439439 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.439559 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.439807 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.439909 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.440184 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.440373 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.440528 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.440703 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.440816 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.441045 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.441212 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.441485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.441573 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.441734 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.441833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.442062 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.442157 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.442384 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.442486 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.442716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.442808 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.443035 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.443126 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.443326 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.443427 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.443642 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.443743 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.443957 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.444058 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.444268 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.444361 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.444594 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.444686 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.444909 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.445002 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.445232 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.445327 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.445564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.445665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.445878 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.445970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.446192 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.446411 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.446504 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.446768 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.446919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.447087 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.447246 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.447417 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.447564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.447866 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.447973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.448061 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.448202 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.448350 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.448561 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.448665 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.448868 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.448974 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.449117 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.449298 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.449466 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.449617 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.449757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.449930 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.450083 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.450239 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.450389 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.450548 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.450699 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.450864 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.451030 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.451212 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.451348 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.451521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.451655 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.451835 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.451958 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.452140 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.452279 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.452470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.452570 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.452778 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.452891 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.453085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.453212 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.453435 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.453559 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.453752 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.453885 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.454046 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.454192 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.454355 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.454515 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.454661 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.454826 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.454970 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.455232 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.455332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.455544 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.455636 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.455852 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.455959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.456164 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.456256 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.456477 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.456570 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.456783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.456877 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.457094 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.457185 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.457459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.457551 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.457830 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.457951 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.458086 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.458179 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.458393 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.458493 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.458711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.458814 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.459028 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.459141 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.459354 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.459445 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.459661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.459755 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.459966 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.460059 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.460278 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.460380 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.460583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.460675 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.460888 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.461146 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.461259 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.461513 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.461614 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.461818 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.461921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.462123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.462217 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.462427 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.462521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.462751 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.462833 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.463054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.463143 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.463362 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.463446 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.463679 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.463759 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.463982 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.464072 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.464287 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.464377 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.464591 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.464673 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.464901 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.464995 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.465316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.465405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.465574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.465831 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.465926 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.466200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.466293 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.466578 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.466680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.467123 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.467510 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.467949 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.468065 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.468337 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.468452 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.468642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.468745 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.468975 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.469184 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.469334 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.469666 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.469801 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.470084 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.470252 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.470347 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.470638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.470738 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.470957 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.471183 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.471278 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.471594 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.471686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.471919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.472107 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.472486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.472590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.472823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.472982 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.473153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.473441 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.473550 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.473807 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.473928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.474129 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.474383 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.474488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.474754 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.474874 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.475070 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.475307 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.475414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.475689 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.475923 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.476018 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.476338 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.476429 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.476669 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.476860 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.477011 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.477338 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.477449 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.477666 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.477832 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.478059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.478285 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.478387 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.478653 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.478784 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.478972 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.479219 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.479344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.479588 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.479712 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.479908 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.480215 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.480322 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.480530 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.480633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.480843 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.481105 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.481199 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.481508 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.481610 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.481826 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.482068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.482163 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.482475 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.482598 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.482793 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.483036 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.483138 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.483464 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.483565 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.483774 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.483969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.484076 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.484392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.484491 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.484710 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.484894 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.485299 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.485411 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.485597 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.485750 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.485938 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.486190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.486284 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.486584 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.486678 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.486907 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.487097 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.487226 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.487527 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.487701 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.487853 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.488017 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.488196 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.488458 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.488567 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.488766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.488938 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.489107 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.489439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.489557 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.489779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.489928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.490086 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.490365 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.490469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.490708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.490840 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.491213 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.491305 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.491586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.491686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.491908 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.492111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.492237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.492542 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.492634 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.492870 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.493028 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.493187 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.493484 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.493580 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.493833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.493972 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.494140 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.494432 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.494535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.494859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.494961 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.495171 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.495406 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.495512 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.495779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.495873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.496093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.496278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.496416 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.496701 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.496793 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.497008 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.497151 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.497381 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.497601 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.497702 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.498008 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.498174 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.498359 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.498605 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.498707 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.498946 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.499058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.499253 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.499505 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.499619 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.499851 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.499943 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.500162 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.500359 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.500466 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.500768 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.500871 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.501069 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.501266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.501411 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.501659 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.501762 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.502016 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.502116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.502366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.502557 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.502769 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.503018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.503125 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.503384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.503495 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.503702 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.503982 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.504076 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.504327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.504493 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.504641 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.504957 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.505062 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.505338 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.505490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.505661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.505932 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.506214 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.506392 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.506550 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.506862 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.506967 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.507278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.507385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.507695 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.507795 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.508016 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.508179 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.508318 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.508697 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.508806 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.508964 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.509059 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.509413 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.509549 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.509642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.509857 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.510004 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.510170 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.510459 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.510563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.510778 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.510906 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.511088 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.511222 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.511396 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.511556 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.511706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.511917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.512056 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.512243 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.512340 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.512649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.512778 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.512899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.513022 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.513244 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.513345 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.513583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.513684 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.513901 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.513984 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.514151 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 07:19:21.514257 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.514519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.514837 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.515148 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.515457 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.515766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.516078 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.516392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.516723 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.517038 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.517370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.517798 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.518110 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.518433 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.518758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.519067 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.519389 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.520176 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.520495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.520822 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.521137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.521500 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.521848 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.522180 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.522507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.522839 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.523126 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.523431 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.523742 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.524064 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.524374 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.524677 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.524983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.525320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.525628 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.525933 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.526238 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.526542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.526850 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.527155 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.527460 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.527765 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.528068 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.528371 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.528674 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.528985 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.529371 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.529698 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.530007 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.530355 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.530664 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.531012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.531347 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.531667 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.531992 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.532307 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.532630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.533048 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.533304 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.533629 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.533954 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.534264 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.534600 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.534912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.535224 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.535535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.535844 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.536152 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.536465 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.536797 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.537123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.537463 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.537791 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.538112 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.538438 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.538758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.539075 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.539402 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.539717 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.540034 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.540351 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.540665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.540979 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.541417 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.541642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.541975 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.542406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.542610 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.542938 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.543276 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.544594 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.544594 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.544594 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.544981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.545108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.545456 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.545768 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 07:19:21.546018 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 07:19:21.666900 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Registered counter for database nova_api Jul 07 07:19:21.687623 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:19:21.696651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:19:21.698478 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Registered counter for database nova_api Jul 07 07:19:21.721472 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:19:21.729437 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:19:21.751709 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.context [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c0cfef6-5327-469c-98b5-96dc22a57a03(cell1) {{(pid=117788) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 07:19:21.755719 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:19:21.757345 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:19:21.758156 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:19:21.760167 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:19:21.762196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Registered counter for database nova_cell0 Jul 07 07:19:21.766422 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Registered counter for database nova_cell1 Jul 07 07:19:21.775923 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:19:21.777129 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:19:21.785094 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:19:21.785305 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:19:21.787756 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.context [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0c0cfef6-5327-469c-98b5-96dc22a57a03(cell1) {{(pid=117787) load_cells /opt/stack/nova/nova/context.py:464}} Jul 07 07:19:21.791818 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:19:21.793441 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:19:21.794235 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:19:21.796310 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:19:21.798350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Registered counter for database nova_cell0 Jul 07 07:19:21.802433 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Registered counter for database nova_cell1 Jul 07 07:19:21.809519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:19:21.812247 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:19:21.815377 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:19:21.928703 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO dbcounter [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Registered counter for database nova_cell0 Jul 07 07:19:21.935721 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_db.sqlalchemy.engines [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:19:21.940885 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writer thread running {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:19:21.955844 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:19:21.964909 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO dbcounter [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Registered counter for database nova_cell0 Jul 07 07:19:21.972070 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_db.sqlalchemy.engines [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 07:19:21.976842 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writer thread running {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 07:19:22.258807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 07:19:22.266251 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 07:19:22.292095 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 07:19:22.300192 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 07:19:22.629120 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 07:19:22.636767 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: WARNING keystonemiddleware.auth_token [None req-4392d2f1-0f46-48b1-b58c-64d3fb0816d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 07:19:22.643364 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557a4d6179c0 pid: 117788 (default app) Jul 07 07:19:22.659587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 07 07:19:22.665685 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: WARNING keystonemiddleware.auth_token [None req-328f85a4-cfe3-4772-a6b5-0a03e95dd739 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 07 07:19:22.671201 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557a4d6179c0 pid: 117787 (default app) Jul 07 07:20:03.363459 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:03.364456 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:03.365072 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:03.365946 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:04.437717 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-06b0909d-c6e1-4798-8058-76e73ae3e51f tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Action: 'create', calling method: .version_select at 0x7fccfc14e5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-781244748", "metadata": {"Type": "work"}}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-06b0909d-c6e1-4798-8058-76e73ae3e51f tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Request method failure captured: Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 121 Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixokjj0FKuIex9VdrohSbObalkBepwS81VAek7CZ74-ZsUln3gvnq7RHFpNzwvAl89kcMZpAHkHoab3h1twXsGOhPAzEkk5VPtBcBU8jOcHUUQc5dJmgdrTZfmHiJKG-PJBkpvcB22bto_py7kz5fsbQhHTvKt6wcPCyMDapDBir5w2E Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:20:04.461978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 00ccad5420c643d5a2156f83eaf508c9 Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-781244748", "metadata": {"Type": "work"}}} Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: Jul 07 07:20:04.463843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-781244748', 'metadata': {'Type': 'work'}}}} Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise error Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi '#$%' Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:20:04.464655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 07:20:04.467449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 07:20:04.468921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 07 07:20:04.468921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.468921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-06b0909d-c6e1-4798-8058-76e73ae3e51f tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:20:04.468921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-06b0909d-c6e1-4798-8058-76e73ae3e51f tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.122639 Jul 07 07:20:04.468921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1155 bytes} [Thu Jul 7 07:20:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 07 07:20:04.683413 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8f7609eb-5017-401f-ba70-ed3ec8cd534b tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Action: 'create', calling method: .version_select at 0x7fccfc1db0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1292432442", "metadata": {"Type": "work"}}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8f7609eb-5017-401f-ba70-ed3ec8cd534b tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Request method failure captured: Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 120 Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixokjj0FKuIex9VdrohSbObalkBepwS81VAek7CZ74-ZsUln3gvnq7RHFpNzwvAl89kcMZpAHkHoab3h1twXsGOhPAzEkk5VPtBcBU8jOcHUUQc5dJmgdrTZfmHiJKG-PJBkpvcB22bto_py7kz5fsbQhHTvKt6wcPCyMDapDBir5w2E Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:20:04.687432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 00ccad5420c643d5a2156f83eaf508c9 Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1292432442", "metadata": {"Type": "work"}}} Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: Jul 07 07:20:04.689385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1292432442', 'metadata': {'Type': 'work'}}}} Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise error Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi '0' Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:20:04.690370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 07:20:04.691708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 07:20:04.692755 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 07 07:20:04.692755 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.692755 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8f7609eb-5017-401f-ba70-ed3ec8cd534b tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:20:04.692755 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8f7609eb-5017-401f-ba70-ed3ec8cd534b tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.217105 Jul 07 07:20:04.692755 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 1/2] 10.222.0.62 () {60 vars in 1155 bytes} [Thu Jul 7 07:20:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 219 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 07:20:04.697983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:04.699356 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:04.700685 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:04.702589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:04.713947 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d7dbe028-a8a7-46bc-9a82-2ef9405ea6e9 tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Action: 'create', calling method: .version_select at 0x7fccfc9f8af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-124851527", "metadata": {"Type": "work"}}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d7dbe028-a8a7-46bc-9a82-2ef9405ea6e9 tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Request method failure captured: Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 118 Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixokjj0FKuIex9VdrohSbObalkBepwS81VAek7CZ74-ZsUln3gvnq7RHFpNzwvAl89kcMZpAHkHoab3h1twXsGOhPAzEkk5VPtBcBU8jOcHUUQc5dJmgdrTZfmHiJKG-PJBkpvcB22bto_py7kz5fsbQhHTvKt6wcPCyMDapDBir5w2E Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:20:04.717150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 00ccad5420c643d5a2156f83eaf508c9 Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-124851527", "metadata": {"Type": "work"}}} Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: Jul 07 07:20:04.718635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-124851527', 'metadata': {'Type': 'work'}}}} Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise error Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi '' Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:20:04.719526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 07 07:20:04.721363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 07 07:20:04.723491 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 07 07:20:04.723491 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:04.724481 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d7dbe028-a8a7-46bc-9a82-2ef9405ea6e9 tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:20:04.725537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d7dbe028-a8a7-46bc-9a82-2ef9405ea6e9 tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029338 Jul 07 07:20:04.726291 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 2/3] 10.222.0.62 () {60 vars in 1155 bytes} [Thu Jul 7 07:20:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 07:20:04.736495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-719c556d-64f7-4e2a-a594-89924172f46a tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Calling method '.version_select at 0x7fccfc0bd4c0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:05.095696 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-46783547-3d12-494f-aa24-b31135b2db21 tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] Action: 'create', calling method: .version_select at 0x7fccfc0d4940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1408265803", "metadata": {"Type": "work"}}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:06.829998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-719c556d-64f7-4e2a-a594-89924172f46a tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] HTTP exception thrown: Volume tempest-invalid-1642686508 could not be found. Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-719c556d-64f7-4e2a-a594-89924172f46a tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Request method failure captured: Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1642686508 HTTP/1.1 Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixokjj0FKuIex9VdrohSbObalkBepwS81VAek7CZ74-ZsUln3gvnq7RHFpNzwvAl89kcMZpAHkHoab3h1twXsGOhPAzEkk5VPtBcBU8jOcHUUQc5dJmgdrTZfmHiJKG-PJBkpvcB22bto_py7kz5fsbQhHTvKt6wcPCyMDapDBir5w2E Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:20:06.833738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 00ccad5420c643d5a2156f83eaf508c9 Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Volume tempest-invalid-1642686508 could not be found. Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': 'tempest-invalid-1642686508'} Jul 07 07:20:06.835255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1642686508 could not be found. (HTTP 404) (Request-ID: req-43203b90-d88f-4902-b466-21a9f953ede4) Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:06.836159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 07:20:06.837542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1642686508 could not be found. Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:20:06.838823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1642686508 could not be found. Jul 07 07:20:06.840108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:06.840108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:06.840108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:06.840108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:06.840108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:06.840108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:06.840108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:20:06.840108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:20:06.840108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1642686508 could not be found. Jul 07 07:20:06.840108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:06.844870 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-719c556d-64f7-4e2a-a594-89924172f46a tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Returning 404 to user: Volume tempest-invalid-1642686508 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:20:06.846095 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-719c556d-64f7-4e2a-a594-89924172f46a tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1642686508" status: 404 len: 99 microversion: 2.1 time: 2.113712 Jul 07 07:20:06.854447 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 3/4] 10.222.0.62 () {58 vars in 1217 bytes} [Thu Jul 7 07:20:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1642686508 => generated 99 bytes in 2122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 07 07:20:06.863446 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1de8b9cc-f341-413f-94fc-039802d9470b tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007491 Jul 07 07:20:06.874637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 4/5] 10.222.0.62 () {58 vars in 1139 bytes} [Thu Jul 7 07:20:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 07 07:20:06.884767 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ec487a92-176d-44d5-bd18-a0d0b1d54623 tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008580 Jul 07 07:20:06.892579 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 5/6] 10.222.0.62 () {58 vars in 1136 bytes} [Thu Jul 7 07:20:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 07 07:20:06.902311 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-439e1115-23af-465a-867c-1d318601ef49 tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Calling method '.version_select at 0x7fccfbf9f310>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:07.101979 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-46783547-3d12-494f-aa24-b31135b2db21 tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.584082 Jul 07 07:20:07.102915 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 2/7] 10.222.0.62 () {60 vars in 1155 bytes} [Thu Jul 7 07:20:04 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2586 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 07 07:20:07.115368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-976914c3-e423-4aaf-905f-e583fbef0d18 tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] Calling method '.version_select at 0x7fccfbfca9d0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:07.153963 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-439e1115-23af-465a-867c-1d318601ef49 tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] HTTP exception thrown: Volume 522d43bd-5dac-4ef2-86e4-caf084b79e60 could not be found. Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-439e1115-23af-465a-867c-1d318601ef49 tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Request method failure captured: Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/os-volumes/522d43bd-5dac-4ef2-86e4-caf084b79e60 HTTP/1.1 Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixokjj0FKuIex9VdrohSbObalkBepwS81VAek7CZ74-ZsUln3gvnq7RHFpNzwvAl89kcMZpAHkHoab3h1twXsGOhPAzEkk5VPtBcBU8jOcHUUQc5dJmgdrTZfmHiJKG-PJBkpvcB22bto_py7kz5fsbQhHTvKt6wcPCyMDapDBir5w2E Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:20:07.159810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 00ccad5420c643d5a2156f83eaf508c9 Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Volume 522d43bd-5dac-4ef2-86e4-caf084b79e60 could not be found. Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '522d43bd-5dac-4ef2-86e4-caf084b79e60'} Jul 07 07:20:07.161195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 522d43bd-5dac-4ef2-86e4-caf084b79e60 could not be found. (HTTP 404) (Request-ID: req-e367de4a-4e5b-4715-9bec-979d48c9b87a) Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:07.161962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 07:20:07.163009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 522d43bd-5dac-4ef2-86e4-caf084b79e60 could not be found. Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 07:20:07.164044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 522d43bd-5dac-4ef2-86e4-caf084b79e60 could not be found. Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 522d43bd-5dac-4ef2-86e4-caf084b79e60 could not be found. Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-439e1115-23af-465a-867c-1d318601ef49 tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Returning 404 to user: Volume 522d43bd-5dac-4ef2-86e4-caf084b79e60 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:20:07.166059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-439e1115-23af-465a-867c-1d318601ef49 tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/522d43bd-5dac-4ef2-86e4-caf084b79e60" status: 404 len: 109 microversion: 2.1 time: 0.269564 Jul 07 07:20:07.176618 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 6/8] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Jul 7 07:20:06 2022] DELETE /compute/v2.1/os-volumes/522d43bd-5dac-4ef2-86e4-caf084b79e60 => generated 109 bytes in 283 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:20:07.195359 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c2601bf7-6232-47d7-b0ae-3314297eb15b tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Calling method '.version_select at 0x7fccfbff1d30>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:07.329417 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-976914c3-e423-4aaf-905f-e583fbef0d18 tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77" status: 200 len: 353 microversion: 2.1 time: 0.218284 Jul 07 07:20:07.330567 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 3/9] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:20:07 2022] GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77 => generated 353 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:20:07.457568 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-c2601bf7-6232-47d7-b0ae-3314297eb15b tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] HTTP exception thrown: Volume 94731713-2177-46e2-b2ec-743530a1a426 could not be found. Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c2601bf7-6232-47d7-b0ae-3314297eb15b tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Request method failure captured: Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/os-volumes/94731713-2177-46e2-b2ec-743530a1a426 HTTP/1.1 Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixokjj0FKuIex9VdrohSbObalkBepwS81VAek7CZ74-ZsUln3gvnq7RHFpNzwvAl89kcMZpAHkHoab3h1twXsGOhPAzEkk5VPtBcBU8jOcHUUQc5dJmgdrTZfmHiJKG-PJBkpvcB22bto_py7kz5fsbQhHTvKt6wcPCyMDapDBir5w2E Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:20:07.462260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/93f50f24f7ca48a09dfc96343450dc53"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 93f50f24f7ca48a09dfc96343450dc53 Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesNegativeTest-1920811352 Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 00ccad5420c643d5a2156f83eaf508c9 Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesNegativeTest-1920811352-project Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Volume 94731713-2177-46e2-b2ec-743530a1a426 could not be found. Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '94731713-2177-46e2-b2ec-743530a1a426'} Jul 07 07:20:07.463638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94731713-2177-46e2-b2ec-743530a1a426 could not be found. (HTTP 404) (Request-ID: req-2f3d8ba2-9388-48dd-bc77-23440399abb6) Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:07.464444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 07:20:07.466188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94731713-2177-46e2-b2ec-743530a1a426 could not be found. Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 07:20:07.467327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94731713-2177-46e2-b2ec-743530a1a426 could not be found. Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94731713-2177-46e2-b2ec-743530a1a426 could not be found. Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c2601bf7-6232-47d7-b0ae-3314297eb15b tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] Returning 404 to user: Volume 94731713-2177-46e2-b2ec-743530a1a426 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:20:07.468490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c2601bf7-6232-47d7-b0ae-3314297eb15b tempest-VolumesNegativeTest-1920811352 tempest-VolumesNegativeTest-1920811352-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/94731713-2177-46e2-b2ec-743530a1a426" status: 404 len: 109 microversion: 2.1 time: 0.285282 Jul 07 07:20:07.471529 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 7/10] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:20:07 2022] GET /compute/v2.1/os-volumes/94731713-2177-46e2-b2ec-743530a1a426 => generated 109 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:20:08.344947 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-63e04c3f-4a45-4e7f-9ddb-e15a3d0bc62f tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] Calling method '.version_select at 0x7fccfbfdb0d0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:08.452464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-63e04c3f-4a45-4e7f-9ddb-e15a3d0bc62f tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77" status: 200 len: 354 microversion: 2.1 time: 0.112662 Jul 07 07:20:08.453312 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 4/11] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:20:08 2022] GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:20:08.475583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-af37ff71-69b4-4fe5-aed3-cfa8a420679f tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] Calling method '.version_select at 0x7fccfbf9fd30>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:08.608011 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-af37ff71-69b4-4fe5-aed3-cfa8a420679f tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77" status: 200 len: 354 microversion: 2.1 time: 0.140306 Jul 07 07:20:08.608936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 8/12] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:20:08 2022] GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77 => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:20:08.649085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8e159a84-2f4d-470b-a561-7715c24a894e tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] Calling method '.version_select at 0x7fccfbfdb790>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:08.859002 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8e159a84-2f4d-470b-a561-7715c24a894e tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77" status: 202 len: 0 microversion: 2.1 time: 0.217363 Jul 07 07:20:08.859890 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 5/13] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Jul 7 07:20:08 2022] DELETE /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:20:08.870344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-331dbe42-3033-47cc-8f9c-6fba09304636 tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] Calling method '.version_select at 0x7fccfbf9f430>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:09.016939 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-331dbe42-3033-47cc-8f9c-6fba09304636 tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77" status: 200 len: 353 microversion: 2.1 time: 0.150560 Jul 07 07:20:09.019256 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 9/14] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:20:08 2022] GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:20:10.040571 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-557233b7-32d5-474f-a3f8-847b01551a2c tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] Calling method '.version_select at 0x7fccfbfcad30>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:10.102234 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-557233b7-32d5-474f-a3f8-847b01551a2c tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] HTTP exception thrown: Volume df8888cc-7486-459f-bcc3-420663cd7f77 could not be found. Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-557233b7-32d5-474f-a3f8-847b01551a2c tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] Request method failure captured: Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77 HTTP/1.1 Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixokkxskgOJNhqke0l-aTzfH7u1HrKpgMKA2vCl-9Ro7i3dqbXvFXnBpF9jIpxxTnRtrtHlJVatY7S6EiA-lrj7vkUJdJj8wX-AM3XZxQ_a86-1_nSnm6FqM_2B9HeuaZxdlQQ-bV7DpNRiB2GG88mUpC2G33igRXp9Jk5DDuDtovQxQ Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 84b6bc8d4371469ebb4ce41341edd578 Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesGetTestJSON-86903695 Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:20:10.106825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/84b6bc8d4371469ebb4ce41341edd578"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/84b6bc8d4371469ebb4ce41341edd578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_84b6bc8d4371469ebb4ce41341edd578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/84b6bc8d4371469ebb4ce41341edd578"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesGetTestJSON-86903695 Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 84b6bc8d4371469ebb4ce41341edd578 Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesGetTestJSON-86903695 Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesGetTestJSON-86903695-project Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: f60ff411561f4519ace8155eab74ede5 Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesGetTestJSON-86903695-project Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Volume df8888cc-7486-459f-bcc3-420663cd7f77 could not be found. Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'df8888cc-7486-459f-bcc3-420663cd7f77'} Jul 07 07:20:10.108398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df8888cc-7486-459f-bcc3-420663cd7f77 could not be found. (HTTP 404) (Request-ID: req-698c2adb-54e6-4e40-95e9-e42d51314196) Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:10.109277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 07:20:10.110588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df8888cc-7486-459f-bcc3-420663cd7f77 could not be found. Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 07:20:10.111928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df8888cc-7486-459f-bcc3-420663cd7f77 could not be found. Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df8888cc-7486-459f-bcc3-420663cd7f77 could not be found. Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:20:10.113711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-557233b7-32d5-474f-a3f8-847b01551a2c tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] Returning 404 to user: Volume df8888cc-7486-459f-bcc3-420663cd7f77 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:20:10.117890 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-557233b7-32d5-474f-a3f8-847b01551a2c tempest-VolumesGetTestJSON-86903695 tempest-VolumesGetTestJSON-86903695-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77" status: 404 len: 109 microversion: 2.1 time: 0.085015 Jul 07 07:20:10.134884 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 6/15] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:20:10 2022] GET /compute/v2.1/os-volumes/df8888cc-7486-459f-bcc3-420663cd7f77 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:20:16.744777 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-28773bdf-e50b-4731-8a84-627725ca3741 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'create', calling method: .version_select at 0x7fccfbf9f8b0>, body: {"keypair": {"name": "tempest-keypair-887985396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOutAsxiKK51DuBZtG7Pg2mTKijZ5bzcV7ngjv01RtunSFC2nfvVCxiwzAYr5rtPpW3/wZvtdgr67I6HEKWEUtWq2efU6OoegJwIoVoSnp8CYnGJJ96AhMu4apIQFpB+g=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:16.904119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-28773bdf-e50b-4731-8a84-627725ca3741 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Getting quotas for project 35c14f84eaf04060acc489e77027c824. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:20:16.956235 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-28773bdf-e50b-4731-8a84-627725ca3741 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Getting quotas for user 16293fa03ced44cc994a0b8ad19ebb89 and project 35c14f84eaf04060acc489e77027c824. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:20:17.097858 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-28773bdf-e50b-4731-8a84-627725ca3741 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.884091 Jul 07 07:20:17.101286 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 10/16] 10.222.0.62 () {60 vars in 1158 bytes} [Thu Jul 7 07:20:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:20:23.328314 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-435003260", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eeaefd19-27c3-4667-8957-3736024eb39e"}], "security_groups": [{"name": "tempest-securitygroup--290766204"}], "key_name": "tempest-keypair-887985396", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:23.504570 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-da36f1cf-f929-416e-86c8-665fcda7bb3b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Action: 'create', calling method: .version_select at 0x7fccfc14eca0>, body: {"keypair": {"name": "tempest-keypair-1781084651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfzmAfYqVNRUIAc/6/LjLcUYg4XOhPX/eVxmhGoYRysVRA8yzqmiJvWw6Z1GIly3eS5yLU3X7ZtFL/3QKjC77ZTHaPaT/SlGI9LpwZtmvflAkzQTcCqcMEHwSW8bGUHfg=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:23.656543 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-da36f1cf-f929-416e-86c8-665fcda7bb3b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Getting quotas for project 7e48122318d446438ef9974475c3f6ca. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:20:23.675681 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-da36f1cf-f929-416e-86c8-665fcda7bb3b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Getting quotas for user d6db138644b14a20a43b3b1b3fa63314 and project 7e48122318d446438ef9974475c3f6ca. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:20:23.842919 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-da36f1cf-f929-416e-86c8-665fcda7bb3b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.874311 Jul 07 07:20:23.845742 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 7/17] 10.222.0.62 () {62 vars in 1199 bytes} [Thu Jul 7 07:20:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 879 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 07 07:20:24.086766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] validate_networks() for [('eeaefd19-27c3-4667-8957-3736024eb39e', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:20:25.556659 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5705fb6c-9b2f-4b2e-a640-9364fa487e36 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: .version_select at 0x7fccfbf73820>, body: {"keypair": {"name": "tempest-keypair-245216453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiAQmoiBOG/l4q8TxUOcbuRwriEULA36H+0/zAzAH8p1Z7iBxvkZ20+B4FO15yyQgJp5/yEenlz1liNiieVLUXP8NIgEOruFb+ZzftSgmgPaeK/9diKsqALE7RvoFNJ5A=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:25.587911 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-5705fb6c-9b2f-4b2e-a640-9364fa487e36 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for project 883f7310b404427fa3ddda37a8d04acc. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:20:25.600268 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-5705fb6c-9b2f-4b2e-a640-9364fa487e36 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for user 58366850e234491cafe268bb56e9e3a1 and project 883f7310b404427fa3ddda37a8d04acc. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:20:25.695075 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5705fb6c-9b2f-4b2e-a640-9364fa487e36 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.827342 Jul 07 07:20:25.697434 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 8/18] 10.222.0.62 () {60 vars in 1158 bytes} [Thu Jul 7 07:20:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:20:26.994451 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:27.730794 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:20:27.731228 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:20:27.731776 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:20:27.732192 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:20:27.732670 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:20:27.760679 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:27.761141 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:27.767387 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:27.770648 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:27.857455 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Getting quotas for project 35c14f84eaf04060acc489e77027c824. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:20:27.869024 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Getting quotas for user 16293fa03ced44cc994a0b8ad19ebb89 and project 35c14f84eaf04060acc489e77027c824. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:20:27.911326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:20:27.918357 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:20:28.260972 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7ee45ca0-7fe2-4eba-93e1-4d8aec9723c6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.937838 Jul 07 07:20:28.282126 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 11/19] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:20:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 4959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 07 07:20:28.285697 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cfca9a98-b69c-4674-8bdc-8386f94ccdd0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:28.286473 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cfca9a98-b69c-4674-8bdc-8386f94ccdd0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:28.933169 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cfca9a98-b69c-4674-8bdc-8386f94ccdd0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:28.984537 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cfca9a98-b69c-4674-8bdc-8386f94ccdd0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1236 microversion: 2.1 time: 0.703093 Jul 07 07:20:29.015950 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 9/20] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:28 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1236 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:29.320850 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-45301889", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6bb8087-3a4e-4f38-8bd3-6dfc3a61f1eb"}], "security_groups": [{"name": "tempest-securitygroup--364104557"}], "key_name": "tempest-keypair-1781084651", "user_data": "}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:29.746600 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] validate_networks() for [('d6bb8087-3a4e-4f38-8bd3-6dfc3a61f1eb', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:20:30.164973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-992108658", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "networks": [{"uuid": "a56e1712-1b59-4008-a533-2d1490b557ca"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:30.301702 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] validate_networks() for [('a56e1712-1b59-4008-a533-2d1490b557ca', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:20:31.912639 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:20:31.913336 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:20:31.913933 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:20:31.915148 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:20:31.915569 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:20:31.933283 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:31.937824 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:31.939542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:31.940297 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:31.991448 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Getting quotas for project 6b6345958b424ceeb06285db0fc8d877. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:20:32.002257 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Getting quotas for user 3401cbd655eb4dffb2acb46cfbdd9259 and project 6b6345958b424ceeb06285db0fc8d877. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:20:32.032664 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:20:32.038018 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:20:32.050679 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:20:32.051399 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:20:32.052794 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:20:32.053367 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:20:32.054046 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:20:32.078195 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:32.081384 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:32.082962 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:32.087665 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:32.144265 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bc4e5cee-17fd-4ab4-9b9e-781316a882d7 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.373907 Jul 07 07:20:32.145833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 12/21] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:20:32.154051 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1c38f027-a87c-423e-ac32-73c4137743be tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:32.154933 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1c38f027-a87c-423e-ac32-73c4137743be tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:32.204744 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c38f027-a87c-423e-ac32-73c4137743be tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:32.207991 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c38f027-a87c-423e-ac32-73c4137743be tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:32.213184 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c38f027-a87c-423e-ac32-73c4137743be tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:32.214774 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c38f027-a87c-423e-ac32-73c4137743be tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:32.232796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Getting quotas for project 7e48122318d446438ef9974475c3f6ca. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:20:32.242608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Getting quotas for user d6db138644b14a20a43b3b1b3fa63314 and project 7e48122318d446438ef9974475c3f6ca. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:20:32.270759 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:20:32.275040 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:20:32.429421 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c60b3da4-d8e7-4945-aa0a-86f4058f0f35 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.103920 Jul 07 07:20:32.437567 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 10/22] 10.222.0.62 () {62 vars in 1187 bytes} [Thu Jul 7 07:20:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 3126 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 07 07:20:32.479686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f07b136-7fea-428e-bf8a-398804115b82 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:32.483225 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f07b136-7fea-428e-bf8a-398804115b82 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:32.850752 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f07b136-7fea-428e-bf8a-398804115b82 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:32.866839 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f07b136-7fea-428e-bf8a-398804115b82 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1214 microversion: 2.1 time: 0.425163 Jul 07 07:20:32.870805 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 11/23] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:32 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1214 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:32.880562 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-acda2725-42c8-48e6-bf3f-cc946791933d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:32.883091 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-acda2725-42c8-48e6-bf3f-cc946791933d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:32.947439 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1c38f027-a87c-423e-ac32-73c4137743be tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:32.999760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-acda2725-42c8-48e6-bf3f-cc946791933d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:33.013646 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-acda2725-42c8-48e6-bf3f-cc946791933d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:33.015859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1c38f027-a87c-423e-ac32-73c4137743be tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1232 microversion: 2.1 time: 0.865261 Jul 07 07:20:33.016246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-acda2725-42c8-48e6-bf3f-cc946791933d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:33.016547 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 13/24] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:32 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1232 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:33.018888 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-acda2725-42c8-48e6-bf3f-cc946791933d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1280 microversion: 2.20 time: 0.146360 Jul 07 07:20:33.019959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 12/25] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:32 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:33.044507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1260801761", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9578812b-5d60-45a0-af5c-eccba67aa04b"}], "security_groups": [{"name": "tempest-securitygroup--1487849042"}], "key_name": "tempest-keypair-245216453", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:33.268671 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] validate_networks() for [('9578812b-5d60-45a0-af5c-eccba67aa04b', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:20:33.889582 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c94c116b-7422-4b4e-9680-324584e13141 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:33.890220 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c94c116b-7422-4b4e-9680-324584e13141 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:34.223018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c94c116b-7422-4b4e-9680-324584e13141 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:34.232180 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c94c116b-7422-4b4e-9680-324584e13141 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1214 microversion: 2.1 time: 0.351222 Jul 07 07:20:34.235785 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 13/26] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:33 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1214 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:34.262066 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2d96decd-bd74-405f-bdf1-dcf530bb52bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:34.263536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2d96decd-bd74-405f-bdf1-dcf530bb52bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:34.281192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d96decd-bd74-405f-bdf1-dcf530bb52bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:34.282594 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d96decd-bd74-405f-bdf1-dcf530bb52bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:34.285522 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d96decd-bd74-405f-bdf1-dcf530bb52bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:34.286343 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2d96decd-bd74-405f-bdf1-dcf530bb52bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:34.651673 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2d96decd-bd74-405f-bdf1-dcf530bb52bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:34.674828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2d96decd-bd74-405f-bdf1-dcf530bb52bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1294 microversion: 2.1 time: 0.437739 Jul 07 07:20:34.681664 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 14/27] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:34 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1294 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:34.695653 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-63f56696-eaeb-4114-bcec-7773e1c81889 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:34.696280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-63f56696-eaeb-4114-bcec-7773e1c81889 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:34.714381 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f56696-eaeb-4114-bcec-7773e1c81889 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:34.714896 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f56696-eaeb-4114-bcec-7773e1c81889 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:34.715751 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f56696-eaeb-4114-bcec-7773e1c81889 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:34.716139 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f56696-eaeb-4114-bcec-7773e1c81889 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:34.956728 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63f56696-eaeb-4114-bcec-7773e1c81889 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:34.970255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63f56696-eaeb-4114-bcec-7773e1c81889 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:34.977679 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63f56696-eaeb-4114-bcec-7773e1c81889 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:34.983617 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-63f56696-eaeb-4114-bcec-7773e1c81889 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1332 microversion: 2.20 time: 0.299818 Jul 07 07:20:34.984993 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 15/28] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:34 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1332 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:35.252406 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb98c36c-7635-47e0-874a-f0b5c06957c9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:35.253508 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb98c36c-7635-47e0-874a-f0b5c06957c9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:35.275238 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb98c36c-7635-47e0-874a-f0b5c06957c9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:35.278950 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb98c36c-7635-47e0-874a-f0b5c06957c9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:35.279817 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb98c36c-7635-47e0-874a-f0b5c06957c9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:35.284533 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb98c36c-7635-47e0-874a-f0b5c06957c9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:35.729026 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:20:35.731097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:20:35.732069 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:20:35.732661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:20:35.733246 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:20:35.760956 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:35.769428 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:35.770575 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:35.772903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:35.865073 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for project 883f7310b404427fa3ddda37a8d04acc. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:20:35.887307 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for user 58366850e234491cafe268bb56e9e3a1 and project 883f7310b404427fa3ddda37a8d04acc. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:20:35.941831 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:20:35.946334 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:20:36.260167 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-26e573a3-dc87-4dec-9cc3-6f350d8f416d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.241278 Jul 07 07:20:36.275441 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 14/29] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:20:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 3252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:20:36.275541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eb98c36c-7635-47e0-874a-f0b5c06957c9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:36.284403 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eb98c36c-7635-47e0-874a-f0b5c06957c9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1266 microversion: 2.1 time: 1.036100 Jul 07 07:20:36.285579 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ca571d75-56e9-469e-bd62-640da6062a31 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:36.308148 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ca571d75-56e9-469e-bd62-640da6062a31 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:36.310589 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 16/30] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:35 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1266 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:20:36.330679 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2975ddb0-e091-4e98-885e-eb36850ee3f6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:36.332754 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2975ddb0-e091-4e98-885e-eb36850ee3f6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:36.337053 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca571d75-56e9-469e-bd62-640da6062a31 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:36.337547 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca571d75-56e9-469e-bd62-640da6062a31 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:36.338459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca571d75-56e9-469e-bd62-640da6062a31 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:36.338907 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca571d75-56e9-469e-bd62-640da6062a31 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:36.354273 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2975ddb0-e091-4e98-885e-eb36850ee3f6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:36.365945 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2975ddb0-e091-4e98-885e-eb36850ee3f6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:36.367939 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2975ddb0-e091-4e98-885e-eb36850ee3f6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:36.374645 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2975ddb0-e091-4e98-885e-eb36850ee3f6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:37.418460 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2975ddb0-e091-4e98-885e-eb36850ee3f6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:37.429201 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2975ddb0-e091-4e98-885e-eb36850ee3f6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:37.453656 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2975ddb0-e091-4e98-885e-eb36850ee3f6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:37.459547 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2975ddb0-e091-4e98-885e-eb36850ee3f6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1338 microversion: 2.20 time: 1.143224 Jul 07 07:20:37.460233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 17/31] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:36 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1338 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:37.478987 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0619c8cd-1a6d-4e80-a33c-7c04019be670 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:37.484557 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0619c8cd-1a6d-4e80-a33c-7c04019be670 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:38.015780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0619c8cd-1a6d-4e80-a33c-7c04019be670 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:38.039453 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0619c8cd-1a6d-4e80-a33c-7c04019be670 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1241 microversion: 2.1 time: 0.576913 Jul 07 07:20:38.062460 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 18/32] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:37 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1241 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:38.089316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f0c0bcd8-41b3-4d6c-a4c1-5496950f9bef tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:38.115677 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f0c0bcd8-41b3-4d6c-a4c1-5496950f9bef tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:38.140579 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0c0bcd8-41b3-4d6c-a4c1-5496950f9bef tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:38.140758 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0c0bcd8-41b3-4d6c-a4c1-5496950f9bef tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:38.144755 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0c0bcd8-41b3-4d6c-a4c1-5496950f9bef tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:38.145289 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0c0bcd8-41b3-4d6c-a4c1-5496950f9bef tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:38.405900 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ca571d75-56e9-469e-bd62-640da6062a31 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:38.417687 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ca571d75-56e9-469e-bd62-640da6062a31 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 2.145136 Jul 07 07:20:38.431058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f0c0bcd8-41b3-4d6c-a4c1-5496950f9bef tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:38.440117 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f0c0bcd8-41b3-4d6c-a4c1-5496950f9bef tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1272 microversion: 2.1 time: 0.367850 Jul 07 07:20:38.440636 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 19/33] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:38 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1272 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:38.440944 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 15/34] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:36 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:38.481122 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e768cc5b-b22f-4b7d-bd45-6ecd839ba4b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:38.481854 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e768cc5b-b22f-4b7d-bd45-6ecd839ba4b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:38.504191 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e768cc5b-b22f-4b7d-bd45-6ecd839ba4b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:38.511239 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e768cc5b-b22f-4b7d-bd45-6ecd839ba4b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:38.512385 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e768cc5b-b22f-4b7d-bd45-6ecd839ba4b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:38.512848 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e768cc5b-b22f-4b7d-bd45-6ecd839ba4b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:38.720219 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e768cc5b-b22f-4b7d-bd45-6ecd839ba4b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:38.738400 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e768cc5b-b22f-4b7d-bd45-6ecd839ba4b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:38.740527 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e768cc5b-b22f-4b7d-bd45-6ecd839ba4b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:38.750010 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e768cc5b-b22f-4b7d-bd45-6ecd839ba4b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1338 microversion: 2.20 time: 0.272462 Jul 07 07:20:38.750652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 20/35] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:38 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1338 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:39.059645 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1d2a1894-cc10-4f0b-846a-8ff0851a6a90 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:39.067929 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1d2a1894-cc10-4f0b-846a-8ff0851a6a90 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:39.096095 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d2a1894-cc10-4f0b-846a-8ff0851a6a90 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:39.100410 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d2a1894-cc10-4f0b-846a-8ff0851a6a90 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:39.102055 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d2a1894-cc10-4f0b-846a-8ff0851a6a90 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:39.106862 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d2a1894-cc10-4f0b-846a-8ff0851a6a90 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:39.436037 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cbd9da7f-1848-4676-846b-9dff66490d83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:39.436696 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cbd9da7f-1848-4676-846b-9dff66490d83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:39.452393 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1d2a1894-cc10-4f0b-846a-8ff0851a6a90 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:39.476967 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1d2a1894-cc10-4f0b-846a-8ff0851a6a90 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1301 microversion: 2.1 time: 0.424172 Jul 07 07:20:39.477619 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 16/36] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:39 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1301 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:39.482216 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cbd9da7f-1848-4676-846b-9dff66490d83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:39.494120 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cbd9da7f-1848-4676-846b-9dff66490d83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:39.495296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cbd9da7f-1848-4676-846b-9dff66490d83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:39.495935 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cbd9da7f-1848-4676-846b-9dff66490d83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:39.503508 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-13d673a0-e85e-415d-9023-41969e0a7cd9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:39.504265 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-13d673a0-e85e-415d-9023-41969e0a7cd9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:39.536611 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13d673a0-e85e-415d-9023-41969e0a7cd9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:39.537076 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13d673a0-e85e-415d-9023-41969e0a7cd9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:39.537901 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13d673a0-e85e-415d-9023-41969e0a7cd9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:39.538343 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13d673a0-e85e-415d-9023-41969e0a7cd9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:40.804275 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cbd9da7f-1848-4676-846b-9dff66490d83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:40.818601 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cbd9da7f-1848-4676-846b-9dff66490d83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 1.386518 Jul 07 07:20:40.821769 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 21/37] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:39 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:20:40.856786 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fb096753-4b77-4fc4-a2f8-cd662fc854cc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:40.857788 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fb096753-4b77-4fc4-a2f8-cd662fc854cc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:40.876140 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb096753-4b77-4fc4-a2f8-cd662fc854cc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:40.884573 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb096753-4b77-4fc4-a2f8-cd662fc854cc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:40.885649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb096753-4b77-4fc4-a2f8-cd662fc854cc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:40.886214 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb096753-4b77-4fc4-a2f8-cd662fc854cc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:41.073003 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-13d673a0-e85e-415d-9023-41969e0a7cd9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:41.082093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-13d673a0-e85e-415d-9023-41969e0a7cd9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 1.594978 Jul 07 07:20:41.100751 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 17/38] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:39 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:41.128038 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2df298c3-8f64-4436-8757-3b9f95f9aae0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:41.133028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2df298c3-8f64-4436-8757-3b9f95f9aae0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:41.204945 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2df298c3-8f64-4436-8757-3b9f95f9aae0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:41.207493 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2df298c3-8f64-4436-8757-3b9f95f9aae0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:41.214527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2df298c3-8f64-4436-8757-3b9f95f9aae0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:41.219626 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2df298c3-8f64-4436-8757-3b9f95f9aae0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:41.447909 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fb096753-4b77-4fc4-a2f8-cd662fc854cc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:41.464319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fb096753-4b77-4fc4-a2f8-cd662fc854cc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:41.469319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fb096753-4b77-4fc4-a2f8-cd662fc854cc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:41.479038 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fb096753-4b77-4fc4-a2f8-cd662fc854cc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.645740 Jul 07 07:20:41.480042 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 22/39] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:40 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:41.840012 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d2ec9283-aae9-4436-81be-dda438cc0813 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:41.841439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d2ec9283-aae9-4436-81be-dda438cc0813 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:41.854264 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2ec9283-aae9-4436-81be-dda438cc0813 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:41.859156 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2ec9283-aae9-4436-81be-dda438cc0813 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:41.862992 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2ec9283-aae9-4436-81be-dda438cc0813 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:41.866519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2df298c3-8f64-4436-8757-3b9f95f9aae0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:41.867346 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2ec9283-aae9-4436-81be-dda438cc0813 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:41.877906 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2df298c3-8f64-4436-8757-3b9f95f9aae0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1299 microversion: 2.1 time: 0.775168 Jul 07 07:20:41.881613 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 18/40] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:41 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1299 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:42.129529 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2677d9c1-512e-4f89-b2d0-e0092079eda9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:42.134764 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2677d9c1-512e-4f89-b2d0-e0092079eda9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:42.196429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2677d9c1-512e-4f89-b2d0-e0092079eda9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:42.199809 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2677d9c1-512e-4f89-b2d0-e0092079eda9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:42.201436 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:42.201639 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2677d9c1-512e-4f89-b2d0-e0092079eda9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:42.213192 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2677d9c1-512e-4f89-b2d0-e0092079eda9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:42.986147 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d2ec9283-aae9-4436-81be-dda438cc0813 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:43.002265 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d2ec9283-aae9-4436-81be-dda438cc0813 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 1.166369 Jul 07 07:20:43.024228 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 23/41] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:41 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:20:43.033606 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9e9b37b5-f091-43c9-a80d-d83d42241d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:43.034607 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9e9b37b5-f091-43c9-a80d-d83d42241d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:43.047170 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e9b37b5-f091-43c9-a80d-d83d42241d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:43.048020 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e9b37b5-f091-43c9-a80d-d83d42241d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:43.049197 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e9b37b5-f091-43c9-a80d-d83d42241d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:43.050230 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9e9b37b5-f091-43c9-a80d-d83d42241d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:43.735292 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2677d9c1-512e-4f89-b2d0-e0092079eda9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:43.747175 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2677d9c1-512e-4f89-b2d0-e0092079eda9 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 1.642088 Jul 07 07:20:43.748463 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 19/42] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:42 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:20:43.754949 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-82fbe704-35be-46ea-a111-3ed146ddd2e5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:43.756298 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-82fbe704-35be-46ea-a111-3ed146ddd2e5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:43.764044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82fbe704-35be-46ea-a111-3ed146ddd2e5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:43.778877 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82fbe704-35be-46ea-a111-3ed146ddd2e5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:43.781158 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82fbe704-35be-46ea-a111-3ed146ddd2e5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:43.781924 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82fbe704-35be-46ea-a111-3ed146ddd2e5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:43.833319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9e9b37b5-f091-43c9-a80d-d83d42241d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:43.859116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9e9b37b5-f091-43c9-a80d-d83d42241d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:43.869553 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9e9b37b5-f091-43c9-a80d-d83d42241d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:43.869553 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9e9b37b5-f091-43c9-a80d-d83d42241d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.838110 Jul 07 07:20:43.875986 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 24/43] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:43 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:44.021086 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4afb0cd3-8014-48a4-bb76-2c4058172ea7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:44.021804 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4afb0cd3-8014-48a4-bb76-2c4058172ea7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:44.040994 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4afb0cd3-8014-48a4-bb76-2c4058172ea7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:44.041512 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4afb0cd3-8014-48a4-bb76-2c4058172ea7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:44.042367 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4afb0cd3-8014-48a4-bb76-2c4058172ea7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:44.042824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4afb0cd3-8014-48a4-bb76-2c4058172ea7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:44.904126 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-82fbe704-35be-46ea-a111-3ed146ddd2e5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:44.917849 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-82fbe704-35be-46ea-a111-3ed146ddd2e5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 1.167860 Jul 07 07:20:44.918437 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 20/44] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:43 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:44.933462 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f423d9a5-0e10-47bd-9210-f5c55475b916 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:44.943043 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f423d9a5-0e10-47bd-9210-f5c55475b916 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:44.972756 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f423d9a5-0e10-47bd-9210-f5c55475b916 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:44.973186 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f423d9a5-0e10-47bd-9210-f5c55475b916 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:44.974042 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f423d9a5-0e10-47bd-9210-f5c55475b916 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:44.974511 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f423d9a5-0e10-47bd-9210-f5c55475b916 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:45.310651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4afb0cd3-8014-48a4-bb76-2c4058172ea7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:45.324824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4afb0cd3-8014-48a4-bb76-2c4058172ea7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 1.304015 Jul 07 07:20:45.327801 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 25/45] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:44 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:45.345212 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-29cf1560-3612-4ece-9c40-d31364782a60 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:45.348525 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-29cf1560-3612-4ece-9c40-d31364782a60 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:45.370222 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29cf1560-3612-4ece-9c40-d31364782a60 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:45.374076 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29cf1560-3612-4ece-9c40-d31364782a60 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:45.378800 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29cf1560-3612-4ece-9c40-d31364782a60 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:45.380284 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-29cf1560-3612-4ece-9c40-d31364782a60 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:45.804426 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:45.926149 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=18 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:46.005933 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f423d9a5-0e10-47bd-9210-f5c55475b916 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:46.014590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f423d9a5-0e10-47bd-9210-f5c55475b916 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 1.089190 Jul 07 07:20:46.015402 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 21/46] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:44 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:46.036912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bedf3f84-c82d-4815-874e-6c12afc314f2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:46.061320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bedf3f84-c82d-4815-874e-6c12afc314f2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:46.088014 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bedf3f84-c82d-4815-874e-6c12afc314f2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:46.088514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bedf3f84-c82d-4815-874e-6c12afc314f2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:46.089334 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bedf3f84-c82d-4815-874e-6c12afc314f2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:46.089831 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bedf3f84-c82d-4815-874e-6c12afc314f2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:46.167965 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-29cf1560-3612-4ece-9c40-d31364782a60 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:46.180613 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-29cf1560-3612-4ece-9c40-d31364782a60 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:46.190291 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-29cf1560-3612-4ece-9c40-d31364782a60 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:46.196197 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-29cf1560-3612-4ece-9c40-d31364782a60 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.865578 Jul 07 07:20:46.196890 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 26/47] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:45 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:46.346182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-96944ad3-eb42-4be6-8443-f1501fee65a0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:46.347987 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-96944ad3-eb42-4be6-8443-f1501fee65a0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:46.367212 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96944ad3-eb42-4be6-8443-f1501fee65a0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:46.372106 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96944ad3-eb42-4be6-8443-f1501fee65a0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:46.373419 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96944ad3-eb42-4be6-8443-f1501fee65a0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:46.374229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96944ad3-eb42-4be6-8443-f1501fee65a0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:47.270058 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bedf3f84-c82d-4815-874e-6c12afc314f2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:47.298592 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bedf3f84-c82d-4815-874e-6c12afc314f2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 1.262401 Jul 07 07:20:47.300812 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 22/48] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:46 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:47.327733 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-43006ed9-634d-48d3-9bf3-19c188f1377f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:47.331041 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-43006ed9-634d-48d3-9bf3-19c188f1377f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:47.367442 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=10 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:47.374092 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43006ed9-634d-48d3-9bf3-19c188f1377f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:47.375073 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43006ed9-634d-48d3-9bf3-19c188f1377f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:47.375522 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43006ed9-634d-48d3-9bf3-19c188f1377f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:47.380536 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43006ed9-634d-48d3-9bf3-19c188f1377f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:47.430897 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-96944ad3-eb42-4be6-8443-f1501fee65a0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:47.439812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-96944ad3-eb42-4be6-8443-f1501fee65a0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 1.098083 Jul 07 07:20:47.449565 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 27/49] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:46 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:47.806826 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-4acf8a8b-ecb2-4e7a-ae11-141430b84c76 req-a1a5f772-5bd5-435a-8c3e-aabde259a40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec188266-15a7-4559-ab29-6025dd7837e5", "tag": "11de54d7-a166-4f12-8b83-93407305355c"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:47.820992 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-43006ed9-634d-48d3-9bf3-19c188f1377f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:47.824208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-4acf8a8b-ecb2-4e7a-ae11-141430b84c76 req-a1a5f772-5bd5-435a-8c3e-aabde259a40e service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:47.824882 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-4acf8a8b-ecb2-4e7a-ae11-141430b84c76 req-a1a5f772-5bd5-435a-8c3e-aabde259a40e service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:47.832269 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-43006ed9-634d-48d3-9bf3-19c188f1377f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.523017 Jul 07 07:20:47.837750 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 23/50] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:47 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:47.845010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d71f8539-9772-498d-a349-4ce8ae1da378 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:47.856344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d71f8539-9772-498d-a349-4ce8ae1da378 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:47.870200 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-4acf8a8b-ecb2-4e7a-ae11-141430b84c76 req-a1a5f772-5bd5-435a-8c3e-aabde259a40e service nova] Creating event network-changed:11de54d7-a166-4f12-8b83-93407305355c for instance ec188266-15a7-4559-ab29-6025dd7837e5 on hv-cinder-82660 Jul 07 07:20:47.871295 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-4acf8a8b-ecb2-4e7a-ae11-141430b84c76 req-a1a5f772-5bd5-435a-8c3e-aabde259a40e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 07 07:20:47.871536 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d71f8539-9772-498d-a349-4ce8ae1da378 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:47.872202 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d71f8539-9772-498d-a349-4ce8ae1da378 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:47.875019 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9dc2dcc-90b4-4d42-a028-433c993f32ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:47.877127 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9dc2dcc-90b4-4d42-a028-433c993f32ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:47.881022 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9dc2dcc-90b4-4d42-a028-433c993f32ce None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:47.883297 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9dc2dcc-90b4-4d42-a028-433c993f32ce None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:47.890188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d71f8539-9772-498d-a349-4ce8ae1da378 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:47.891797 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d71f8539-9772-498d-a349-4ce8ae1da378 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:47.900685 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.compute.rpcapi [None req-d9dc2dcc-90b4-4d42-a028-433c993f32ce None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 07 07:20:47.902178 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9dc2dcc-90b4-4d42-a028-433c993f32ce None None] Releasing lock "compute-rpcapi-router" {{(pid=117788) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 07 07:20:47.955429 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d9dc2dcc-90b4-4d42-a028-433c993f32ce None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502931 Jul 07 07:20:47.959126 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 28/51] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:20:48.312574 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=24 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:48.317939 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-36e2b4c0-a82d-4c44-90fd-329b7f097964 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:48.319097 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-36e2b4c0-a82d-4c44-90fd-329b7f097964 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:48.335953 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36e2b4c0-a82d-4c44-90fd-329b7f097964 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:48.338880 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36e2b4c0-a82d-4c44-90fd-329b7f097964 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:48.341589 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36e2b4c0-a82d-4c44-90fd-329b7f097964 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:48.347789 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36e2b4c0-a82d-4c44-90fd-329b7f097964 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:48.576522 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d71f8539-9772-498d-a349-4ce8ae1da378 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:48.586601 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d71f8539-9772-498d-a349-4ce8ae1da378 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:48.588147 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d71f8539-9772-498d-a349-4ce8ae1da378 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:48.589364 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d71f8539-9772-498d-a349-4ce8ae1da378 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.749954 Jul 07 07:20:48.589928 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 24/52] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:47 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:48.605485 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-401c7ae2-f35d-4179-8c92-fa250b9fe1d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:48.610306 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-401c7ae2-f35d-4179-8c92-fa250b9fe1d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:48.620940 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-401c7ae2-f35d-4179-8c92-fa250b9fe1d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:48.623791 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-401c7ae2-f35d-4179-8c92-fa250b9fe1d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:48.629703 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-401c7ae2-f35d-4179-8c92-fa250b9fe1d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:48.630440 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-401c7ae2-f35d-4179-8c92-fa250b9fe1d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:48.808772 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-36e2b4c0-a82d-4c44-90fd-329b7f097964 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:48.842349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-36e2b4c0-a82d-4c44-90fd-329b7f097964 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.529513 Jul 07 07:20:48.843945 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 29/53] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:48 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:48.861702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e8ad9ca0-8c25-48c2-be1b-12426e2db6c2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:48.874238 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e8ad9ca0-8c25-48c2-be1b-12426e2db6c2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:48.900838 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8ad9ca0-8c25-48c2-be1b-12426e2db6c2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:48.902736 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8ad9ca0-8c25-48c2-be1b-12426e2db6c2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:48.905269 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8ad9ca0-8c25-48c2-be1b-12426e2db6c2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:48.906222 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8ad9ca0-8c25-48c2-be1b-12426e2db6c2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:49.356658 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-401c7ae2-f35d-4179-8c92-fa250b9fe1d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:49.370564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-401c7ae2-f35d-4179-8c92-fa250b9fe1d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 0.773617 Jul 07 07:20:49.373587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 25/54] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:48 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:49.501472 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-b4dc6c75-5695-4e4a-9ec6-eee8067d0078 req-e9232a57-492e-4865-8955-abd61195b37e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f327dd6-9e19-4aa6-bdb1-7706c651c08c", "tag": "a0f4f29b-0ccc-4bff-bdf2-1469d945011f"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:49.524701 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b4dc6c75-5695-4e4a-9ec6-eee8067d0078 req-e9232a57-492e-4865-8955-abd61195b37e service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:49.525837 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b4dc6c75-5695-4e4a-9ec6-eee8067d0078 req-e9232a57-492e-4865-8955-abd61195b37e service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:49.581297 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-b4dc6c75-5695-4e4a-9ec6-eee8067d0078 req-e9232a57-492e-4865-8955-abd61195b37e service nova] Creating event network-changed:a0f4f29b-0ccc-4bff-bdf2-1469d945011f for instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c on hv-cinder-82660 Jul 07 07:20:49.583079 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b4dc6c75-5695-4e4a-9ec6-eee8067d0078 req-e9232a57-492e-4865-8955-abd61195b37e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 07 07:20:49.585740 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19eecde5-a536-4b67-bcfe-7dc38846be7a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:49.586866 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19eecde5-a536-4b67-bcfe-7dc38846be7a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:49.588692 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19eecde5-a536-4b67-bcfe-7dc38846be7a None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:49.589835 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19eecde5-a536-4b67-bcfe-7dc38846be7a None None] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:49.621538 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.compute.rpcapi [None req-19eecde5-a536-4b67-bcfe-7dc38846be7a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 07 07:20:49.623381 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-19eecde5-a536-4b67-bcfe-7dc38846be7a None None] Releasing lock "compute-rpcapi-router" {{(pid=117787) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 07 07:20:49.662520 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-19eecde5-a536-4b67-bcfe-7dc38846be7a None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287418 Jul 07 07:20:49.667144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 26/55] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:20:49.670213 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e8ad9ca0-8c25-48c2-be1b-12426e2db6c2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:49.680971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f7894d21-5568-4158-b0f3-6f646424726e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:49.682655 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f7894d21-5568-4158-b0f3-6f646424726e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:49.682976 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e8ad9ca0-8c25-48c2-be1b-12426e2db6c2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.827420 Jul 07 07:20:49.683666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 30/56] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:48 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:49.699461 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f7894d21-5568-4158-b0f3-6f646424726e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:49.700255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f7894d21-5568-4158-b0f3-6f646424726e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:49.702251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f7894d21-5568-4158-b0f3-6f646424726e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:49.703385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f7894d21-5568-4158-b0f3-6f646424726e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:49.860191 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1367dbab-0f32-4860-882e-b697811acdc5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:49.861008 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1367dbab-0f32-4860-882e-b697811acdc5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:49.867284 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1367dbab-0f32-4860-882e-b697811acdc5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:49.867716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1367dbab-0f32-4860-882e-b697811acdc5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:49.868518 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1367dbab-0f32-4860-882e-b697811acdc5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:49.868946 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1367dbab-0f32-4860-882e-b697811acdc5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:49.893894 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:50.030520 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f7894d21-5568-4158-b0f3-6f646424726e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:50.047489 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f7894d21-5568-4158-b0f3-6f646424726e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:50.052301 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f7894d21-5568-4158-b0f3-6f646424726e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:50.054017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f7894d21-5568-4158-b0f3-6f646424726e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.385348 Jul 07 07:20:50.062328 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 27/57] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:49 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:50.149265 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1367dbab-0f32-4860-882e-b697811acdc5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:50.159236 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1367dbab-0f32-4860-882e-b697811acdc5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.303009 Jul 07 07:20:50.160368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 31/58] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:49 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:20:50.393249 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ca7ea4ac-1510-4a00-aa19-72b9d909aa3c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:50.393249 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ca7ea4ac-1510-4a00-aa19-72b9d909aa3c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:50.397419 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca7ea4ac-1510-4a00-aa19-72b9d909aa3c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:50.397876 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca7ea4ac-1510-4a00-aa19-72b9d909aa3c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:50.398694 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca7ea4ac-1510-4a00-aa19-72b9d909aa3c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:50.399124 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca7ea4ac-1510-4a00-aa19-72b9d909aa3c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:50.446686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-dc3df0a6-6c81-4e6e-8fab-e7e186cd455f req-2d024cc2-e755-4b77-b98e-256f7ac79c65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3f12d6-445b-459b-b4be-a6cb33e08ad5", "tag": "62ba87a0-ac1a-413f-a251-9750b64de7da"}, {"name": "network-changed", "server_uuid": "5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c", "tag": "7d78694f-a735-488f-84c8-ca44f4d7aba7"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:50.466433 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-dc3df0a6-6c81-4e6e-8fab-e7e186cd455f req-2d024cc2-e755-4b77-b98e-256f7ac79c65 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:50.466433 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-dc3df0a6-6c81-4e6e-8fab-e7e186cd455f req-2d024cc2-e755-4b77-b98e-256f7ac79c65 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:50.504665 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-dc3df0a6-6c81-4e6e-8fab-e7e186cd455f req-2d024cc2-e755-4b77-b98e-256f7ac79c65 service nova] Creating event network-changed:62ba87a0-ac1a-413f-a251-9750b64de7da for instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 on hv-cinder-82660 Jul 07 07:20:50.505193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-dc3df0a6-6c81-4e6e-8fab-e7e186cd455f req-2d024cc2-e755-4b77-b98e-256f7ac79c65 service nova] Creating event network-changed:7d78694f-a735-488f-84c8-ca44f4d7aba7 for instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c on hv-cinder-82660 Jul 07 07:20:50.516940 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-dc3df0a6-6c81-4e6e-8fab-e7e186cd455f req-2d024cc2-e755-4b77-b98e-256f7ac79c65 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075542 Jul 07 07:20:50.517955 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 32/59] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:20:50.675950 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ca7ea4ac-1510-4a00-aa19-72b9d909aa3c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:50.687210 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ca7ea4ac-1510-4a00-aa19-72b9d909aa3c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 0.300615 Jul 07 07:20:50.688113 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 28/60] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:50 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:50.706247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8b8eb157-3ac0-4e8b-b3e9-8028e927fda1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:50.707147 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8b8eb157-3ac0-4e8b-b3e9-8028e927fda1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:50.714604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:50.716451 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b8eb157-3ac0-4e8b-b3e9-8028e927fda1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:50.716984 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b8eb157-3ac0-4e8b-b3e9-8028e927fda1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:50.717881 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b8eb157-3ac0-4e8b-b3e9-8028e927fda1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:50.718556 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8b8eb157-3ac0-4e8b-b3e9-8028e927fda1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:50.950917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8b8eb157-3ac0-4e8b-b3e9-8028e927fda1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:50.963630 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8b8eb157-3ac0-4e8b-b3e9-8028e927fda1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.264087 Jul 07 07:20:50.964606 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 33/61] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:50 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:51.072662 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-094e9069-1792-437b-8c5d-0e614b6d20d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:51.073327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-094e9069-1792-437b-8c5d-0e614b6d20d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:51.081137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-094e9069-1792-437b-8c5d-0e614b6d20d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:51.081884 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-094e9069-1792-437b-8c5d-0e614b6d20d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:51.082834 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-094e9069-1792-437b-8c5d-0e614b6d20d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:51.083408 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-094e9069-1792-437b-8c5d-0e614b6d20d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:51.178411 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ff22d39d-436f-4202-9082-a9508f4a3787 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:51.179130 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ff22d39d-436f-4202-9082-a9508f4a3787 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:51.191996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff22d39d-436f-4202-9082-a9508f4a3787 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:51.193737 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff22d39d-436f-4202-9082-a9508f4a3787 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:51.194702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff22d39d-436f-4202-9082-a9508f4a3787 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:51.195154 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff22d39d-436f-4202-9082-a9508f4a3787 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:51.465338 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-094e9069-1792-437b-8c5d-0e614b6d20d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:51.470870 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:51.504271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-094e9069-1792-437b-8c5d-0e614b6d20d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:51.507277 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-094e9069-1792-437b-8c5d-0e614b6d20d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:51.517326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-094e9069-1792-437b-8c5d-0e614b6d20d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.445990 Jul 07 07:20:51.521038 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 29/62] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:51 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:51.580311 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ff22d39d-436f-4202-9082-a9508f4a3787 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:51.590533 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ff22d39d-436f-4202-9082-a9508f4a3787 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.416407 Jul 07 07:20:51.605472 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 34/63] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:51 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:51.716785 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e10d17cb-7dda-4087-b051-f47ef69151d1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:51.717655 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e10d17cb-7dda-4087-b051-f47ef69151d1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:51.733516 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e10d17cb-7dda-4087-b051-f47ef69151d1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:51.734191 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e10d17cb-7dda-4087-b051-f47ef69151d1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:51.735504 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e10d17cb-7dda-4087-b051-f47ef69151d1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:51.736130 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e10d17cb-7dda-4087-b051-f47ef69151d1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:51.921121 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e10d17cb-7dda-4087-b051-f47ef69151d1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:51.929902 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e10d17cb-7dda-4087-b051-f47ef69151d1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 0.224359 Jul 07 07:20:51.939947 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 30/64] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:51 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:51.986189 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-14f7c284-81b2-47f4-a384-12e3e12804db tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:51.986768 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-14f7c284-81b2-47f4-a384-12e3e12804db tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:51.997817 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14f7c284-81b2-47f4-a384-12e3e12804db tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:52.001716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14f7c284-81b2-47f4-a384-12e3e12804db tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:52.001716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14f7c284-81b2-47f4-a384-12e3e12804db tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:52.001716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-14f7c284-81b2-47f4-a384-12e3e12804db tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:52.232188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-14f7c284-81b2-47f4-a384-12e3e12804db tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:52.257504 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-14f7c284-81b2-47f4-a384-12e3e12804db tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.278604 Jul 07 07:20:52.262404 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 35/65] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:51 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:20:52.543498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f714c32a-a83a-4ee5-9685-8fdf9557de53 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:52.544906 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f714c32a-a83a-4ee5-9685-8fdf9557de53 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:52.557719 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f714c32a-a83a-4ee5-9685-8fdf9557de53 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:52.558403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f714c32a-a83a-4ee5-9685-8fdf9557de53 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:52.559798 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f714c32a-a83a-4ee5-9685-8fdf9557de53 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:52.560603 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f714c32a-a83a-4ee5-9685-8fdf9557de53 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:52.609912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0772f985-c835-4eae-8fe0-23575abf2e48 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:52.615230 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0772f985-c835-4eae-8fe0-23575abf2e48 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:52.627181 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0772f985-c835-4eae-8fe0-23575abf2e48 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:52.627939 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0772f985-c835-4eae-8fe0-23575abf2e48 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:52.628717 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0772f985-c835-4eae-8fe0-23575abf2e48 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:52.629388 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0772f985-c835-4eae-8fe0-23575abf2e48 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:52.886449 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f714c32a-a83a-4ee5-9685-8fdf9557de53 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:52.905615 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f714c32a-a83a-4ee5-9685-8fdf9557de53 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:52.908462 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f714c32a-a83a-4ee5-9685-8fdf9557de53 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:52.917519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f714c32a-a83a-4ee5-9685-8fdf9557de53 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.377018 Jul 07 07:20:52.918433 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 31/66] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:52 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:52.949593 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-13387724-b107-4684-a69f-825db00d8213 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:52.950853 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-13387724-b107-4684-a69f-825db00d8213 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:52.975876 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13387724-b107-4684-a69f-825db00d8213 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:52.976613 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13387724-b107-4684-a69f-825db00d8213 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:52.977585 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13387724-b107-4684-a69f-825db00d8213 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:52.978175 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-13387724-b107-4684-a69f-825db00d8213 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:53.055110 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0772f985-c835-4eae-8fe0-23575abf2e48 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:53.065944 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0772f985-c835-4eae-8fe0-23575abf2e48 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.460025 Jul 07 07:20:53.079462 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 36/67] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:52 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:53.219885 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-13387724-b107-4684-a69f-825db00d8213 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:53.236941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-13387724-b107-4684-a69f-825db00d8213 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 0.293792 Jul 07 07:20:53.237768 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 32/68] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:52 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:53.280567 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4e05a3df-0029-4b13-a5ab-968d5e0162f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:53.281170 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4e05a3df-0029-4b13-a5ab-968d5e0162f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:53.287837 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e05a3df-0029-4b13-a5ab-968d5e0162f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:53.287837 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e05a3df-0029-4b13-a5ab-968d5e0162f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:53.288771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e05a3df-0029-4b13-a5ab-968d5e0162f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:53.289014 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e05a3df-0029-4b13-a5ab-968d5e0162f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:53.506683 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4e05a3df-0029-4b13-a5ab-968d5e0162f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:53.516137 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4e05a3df-0029-4b13-a5ab-968d5e0162f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.237839 Jul 07 07:20:53.516137 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 37/69] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:53 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:53.935802 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e549cc10-ca81-4836-8738-811d724efba6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:53.936421 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e549cc10-ca81-4836-8738-811d724efba6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:53.944309 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e549cc10-ca81-4836-8738-811d724efba6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:53.945281 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e549cc10-ca81-4836-8738-811d724efba6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:53.946237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e549cc10-ca81-4836-8738-811d724efba6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:53.946675 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e549cc10-ca81-4836-8738-811d724efba6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:54.090944 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-27ba348a-c7ca-4b84-a7da-d392903b9e35 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:54.091560 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-27ba348a-c7ca-4b84-a7da-d392903b9e35 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:54.100822 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27ba348a-c7ca-4b84-a7da-d392903b9e35 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:54.101978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27ba348a-c7ca-4b84-a7da-d392903b9e35 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:54.102219 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27ba348a-c7ca-4b84-a7da-d392903b9e35 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:54.102672 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27ba348a-c7ca-4b84-a7da-d392903b9e35 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:54.127115 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e549cc10-ca81-4836-8738-811d724efba6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:54.139770 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e549cc10-ca81-4836-8738-811d724efba6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:54.142025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e549cc10-ca81-4836-8738-811d724efba6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:54.143470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e549cc10-ca81-4836-8738-811d724efba6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.212045 Jul 07 07:20:54.155574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 33/70] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:53 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:54.255523 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3ba0789e-eb07-47a9-bbd6-1be447b4697e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:54.256150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3ba0789e-eb07-47a9-bbd6-1be447b4697e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:54.267199 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ba0789e-eb07-47a9-bbd6-1be447b4697e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:54.267783 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ba0789e-eb07-47a9-bbd6-1be447b4697e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:54.268578 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ba0789e-eb07-47a9-bbd6-1be447b4697e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:54.269018 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3ba0789e-eb07-47a9-bbd6-1be447b4697e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:54.314769 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-27ba348a-c7ca-4b84-a7da-d392903b9e35 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:54.323087 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-27ba348a-c7ca-4b84-a7da-d392903b9e35 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.236305 Jul 07 07:20:54.324158 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 38/71] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:54 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:54.535893 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b398ff3d-63d1-4906-9d11-0e13c5e93612 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:54.536609 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b398ff3d-63d1-4906-9d11-0e13c5e93612 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:54.553353 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b398ff3d-63d1-4906-9d11-0e13c5e93612 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:54.553810 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b398ff3d-63d1-4906-9d11-0e13c5e93612 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:54.554595 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b398ff3d-63d1-4906-9d11-0e13c5e93612 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:54.555030 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b398ff3d-63d1-4906-9d11-0e13c5e93612 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:54.728780 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3ba0789e-eb07-47a9-bbd6-1be447b4697e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:54.740147 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3ba0789e-eb07-47a9-bbd6-1be447b4697e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 0.487994 Jul 07 07:20:54.742522 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 34/72] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:54 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:54.789570 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b398ff3d-63d1-4906-9d11-0e13c5e93612 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:54.799264 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b398ff3d-63d1-4906-9d11-0e13c5e93612 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.267557 Jul 07 07:20:54.799941 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 39/73] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:54 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:20:55.166575 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-37b69763-e98f-44b0-8202-20c64a9d864f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:55.168958 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-37b69763-e98f-44b0-8202-20c64a9d864f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:55.178296 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37b69763-e98f-44b0-8202-20c64a9d864f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:55.179143 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37b69763-e98f-44b0-8202-20c64a9d864f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:55.180399 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37b69763-e98f-44b0-8202-20c64a9d864f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:55.181161 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37b69763-e98f-44b0-8202-20c64a9d864f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:55.341627 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f0032cfe-f127-4622-bed5-5b3cae5551ed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:55.343289 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f0032cfe-f127-4622-bed5-5b3cae5551ed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:55.355207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0032cfe-f127-4622-bed5-5b3cae5551ed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:55.355921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0032cfe-f127-4622-bed5-5b3cae5551ed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:55.357045 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0032cfe-f127-4622-bed5-5b3cae5551ed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:55.357866 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f0032cfe-f127-4622-bed5-5b3cae5551ed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:55.509589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-37b69763-e98f-44b0-8202-20c64a9d864f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:55.520738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-37b69763-e98f-44b0-8202-20c64a9d864f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:55.526865 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-37b69763-e98f-44b0-8202-20c64a9d864f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:55.528495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-37b69763-e98f-44b0-8202-20c64a9d864f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.369218 Jul 07 07:20:55.540464 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 35/74] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:55 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:55.549311 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f0032cfe-f127-4622-bed5-5b3cae5551ed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:55.559854 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f0032cfe-f127-4622-bed5-5b3cae5551ed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.223138 Jul 07 07:20:55.570530 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 40/75] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:55 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:55.760255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-62794426-2c06-4365-910b-04b349ae4009 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:55.761709 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-62794426-2c06-4365-910b-04b349ae4009 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:55.773708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62794426-2c06-4365-910b-04b349ae4009 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:55.775744 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62794426-2c06-4365-910b-04b349ae4009 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:55.777082 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62794426-2c06-4365-910b-04b349ae4009 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:55.779025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62794426-2c06-4365-910b-04b349ae4009 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:55.827388 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cc56cbf0-663b-4194-bdc2-ffc91e0929a1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:55.829538 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cc56cbf0-663b-4194-bdc2-ffc91e0929a1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:55.862573 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc56cbf0-663b-4194-bdc2-ffc91e0929a1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:55.867593 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc56cbf0-663b-4194-bdc2-ffc91e0929a1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:55.868945 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc56cbf0-663b-4194-bdc2-ffc91e0929a1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:55.869607 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc56cbf0-663b-4194-bdc2-ffc91e0929a1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:56.513899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-62794426-2c06-4365-910b-04b349ae4009 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:56.536005 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-62794426-2c06-4365-910b-04b349ae4009 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 0.778249 Jul 07 07:20:56.537194 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 36/76] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:55 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:56.554359 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7411b31b-47ce-41f3-8101-c80b9bb24c77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:56.554985 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7411b31b-47ce-41f3-8101-c80b9bb24c77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:56.558361 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cc56cbf0-663b-4194-bdc2-ffc91e0929a1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:56.569969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cc56cbf0-663b-4194-bdc2-ffc91e0929a1 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.750064 Jul 07 07:20:56.577596 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7411b31b-47ce-41f3-8101-c80b9bb24c77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:56.578473 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7411b31b-47ce-41f3-8101-c80b9bb24c77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:56.579673 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7411b31b-47ce-41f3-8101-c80b9bb24c77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:56.593596 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 41/77] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:55 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:56.594882 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7411b31b-47ce-41f3-8101-c80b9bb24c77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:56.598673 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ca58b1f5-5ea2-49f6-a954-4e44d017e16c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:56.605129 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ca58b1f5-5ea2-49f6-a954-4e44d017e16c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:56.622342 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca58b1f5-5ea2-49f6-a954-4e44d017e16c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:56.624284 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca58b1f5-5ea2-49f6-a954-4e44d017e16c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:56.627652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca58b1f5-5ea2-49f6-a954-4e44d017e16c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:56.633323 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca58b1f5-5ea2-49f6-a954-4e44d017e16c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:57.031156 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7411b31b-47ce-41f3-8101-c80b9bb24c77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:57.050609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7411b31b-47ce-41f3-8101-c80b9bb24c77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:57.066612 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7411b31b-47ce-41f3-8101-c80b9bb24c77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:57.070536 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7411b31b-47ce-41f3-8101-c80b9bb24c77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.519425 Jul 07 07:20:57.073293 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 37/78] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:56 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:57.137278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ca58b1f5-5ea2-49f6-a954-4e44d017e16c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:57.146930 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ca58b1f5-5ea2-49f6-a954-4e44d017e16c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.551958 Jul 07 07:20:57.150222 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 42/79] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:56 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:57.197311 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-d558717e-9c20-442b-a045-d145438a7f76 req-9ea60615-c7df-4797-9603-eb1d80505ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec188266-15a7-4559-ab29-6025dd7837e5", "name": "network-vif-plugged", "status": "completed", "tag": "11de54d7-a166-4f12-8b83-93407305355c"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:20:57.208390 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-d558717e-9c20-442b-a045-d145438a7f76 req-9ea60615-c7df-4797-9603-eb1d80505ab3 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:57.208831 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-d558717e-9c20-442b-a045-d145438a7f76 req-9ea60615-c7df-4797-9603-eb1d80505ab3 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:57.225155 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-d558717e-9c20-442b-a045-d145438a7f76 req-9ea60615-c7df-4797-9603-eb1d80505ab3 service nova] Creating event network-vif-plugged:11de54d7-a166-4f12-8b83-93407305355c for instance ec188266-15a7-4559-ab29-6025dd7837e5 on hv-cinder-82660 Jul 07 07:20:57.234312 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-d558717e-9c20-442b-a045-d145438a7f76 req-9ea60615-c7df-4797-9603-eb1d80505ab3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148356 Jul 07 07:20:57.238429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 38/80] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:20:57.554004 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0243fea3-dd83-4c91-a770-e9dea55bea72 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:57.555749 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0243fea3-dd83-4c91-a770-e9dea55bea72 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:57.566876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0243fea3-dd83-4c91-a770-e9dea55bea72 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:57.567891 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0243fea3-dd83-4c91-a770-e9dea55bea72 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:57.568761 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0243fea3-dd83-4c91-a770-e9dea55bea72 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:57.569209 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0243fea3-dd83-4c91-a770-e9dea55bea72 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:57.594983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7ac3124d-509f-4134-8606-83a101f9010f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:57.597626 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7ac3124d-509f-4134-8606-83a101f9010f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:57.612964 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ac3124d-509f-4134-8606-83a101f9010f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:57.614682 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ac3124d-509f-4134-8606-83a101f9010f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:57.618076 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ac3124d-509f-4134-8606-83a101f9010f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:57.620846 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7ac3124d-509f-4134-8606-83a101f9010f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:57.899837 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:58.113235 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7ac3124d-509f-4134-8606-83a101f9010f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:58.139732 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7ac3124d-509f-4134-8606-83a101f9010f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.553513 Jul 07 07:20:58.143591 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 39/81] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:57 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:58.162922 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c391daba-217d-4cd5-9d59-88dc9864bfbe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:58.166832 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c391daba-217d-4cd5-9d59-88dc9864bfbe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:58.185093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c391daba-217d-4cd5-9d59-88dc9864bfbe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:58.185821 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c391daba-217d-4cd5-9d59-88dc9864bfbe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:58.188203 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c391daba-217d-4cd5-9d59-88dc9864bfbe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:58.193364 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c391daba-217d-4cd5-9d59-88dc9864bfbe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:58.224338 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0243fea3-dd83-4c91-a770-e9dea55bea72 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:58.235016 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0243fea3-dd83-4c91-a770-e9dea55bea72 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 0.685846 Jul 07 07:20:58.239233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 43/82] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:57 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:58.253016 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e36b9d89-fccf-448a-a0cf-dc63ded6270b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:58.254907 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e36b9d89-fccf-448a-a0cf-dc63ded6270b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:58.274985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e36b9d89-fccf-448a-a0cf-dc63ded6270b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:58.279758 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e36b9d89-fccf-448a-a0cf-dc63ded6270b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:58.280690 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e36b9d89-fccf-448a-a0cf-dc63ded6270b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:58.281135 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e36b9d89-fccf-448a-a0cf-dc63ded6270b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:58.562123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c391daba-217d-4cd5-9d59-88dc9864bfbe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:58.571966 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c391daba-217d-4cd5-9d59-88dc9864bfbe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:58.573581 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c391daba-217d-4cd5-9d59-88dc9864bfbe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:58.585629 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c391daba-217d-4cd5-9d59-88dc9864bfbe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.438434 Jul 07 07:20:58.590674 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 40/83] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:58 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:58.659361 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e36b9d89-fccf-448a-a0cf-dc63ded6270b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:58.682607 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e36b9d89-fccf-448a-a0cf-dc63ded6270b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.441521 Jul 07 07:20:58.684434 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 44/84] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:58 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:20:59.157117 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b68435aa-eb05-4451-a09d-b5b54f9df834 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:59.158494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b68435aa-eb05-4451-a09d-b5b54f9df834 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:59.166973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b68435aa-eb05-4451-a09d-b5b54f9df834 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:59.167594 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b68435aa-eb05-4451-a09d-b5b54f9df834 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:59.168447 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b68435aa-eb05-4451-a09d-b5b54f9df834 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:59.168965 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b68435aa-eb05-4451-a09d-b5b54f9df834 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:59.267796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-00bca734-dce8-4618-801b-faf7e92d8c67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:59.268757 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-00bca734-dce8-4618-801b-faf7e92d8c67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:59.276120 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00bca734-dce8-4618-801b-faf7e92d8c67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:59.276753 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00bca734-dce8-4618-801b-faf7e92d8c67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:59.277634 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00bca734-dce8-4618-801b-faf7e92d8c67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:59.278135 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00bca734-dce8-4618-801b-faf7e92d8c67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:59.458215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b68435aa-eb05-4451-a09d-b5b54f9df834 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:59.474139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b68435aa-eb05-4451-a09d-b5b54f9df834 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.316948 Jul 07 07:20:59.474139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 41/85] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:59 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:20:59.569284 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-00bca734-dce8-4618-801b-faf7e92d8c67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:59.578061 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-00bca734-dce8-4618-801b-faf7e92d8c67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 0.314523 Jul 07 07:20:59.578998 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 45/86] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:59 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:20:59.615639 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d9691c1c-5cbe-4eb0-a6bf-1e189377c588 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:59.616745 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d9691c1c-5cbe-4eb0-a6bf-1e189377c588 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:59.620356 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:20:59.625110 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d9691c1c-5cbe-4eb0-a6bf-1e189377c588 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:59.625962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d9691c1c-5cbe-4eb0-a6bf-1e189377c588 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:59.626997 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d9691c1c-5cbe-4eb0-a6bf-1e189377c588 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:59.627604 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d9691c1c-5cbe-4eb0-a6bf-1e189377c588 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:59.702874 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1a0a3c6d-8279-4361-a12f-58675db513ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:20:59.704597 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1a0a3c6d-8279-4361-a12f-58675db513ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:20:59.724812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a0a3c6d-8279-4361-a12f-58675db513ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:59.726809 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a0a3c6d-8279-4361-a12f-58675db513ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:59.729175 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a0a3c6d-8279-4361-a12f-58675db513ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:20:59.730168 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a0a3c6d-8279-4361-a12f-58675db513ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:20:59.874944 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d9691c1c-5cbe-4eb0-a6bf-1e189377c588 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:59.888713 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d9691c1c-5cbe-4eb0-a6bf-1e189377c588 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:59.891355 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d9691c1c-5cbe-4eb0-a6bf-1e189377c588 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:59.915581 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d9691c1c-5cbe-4eb0-a6bf-1e189377c588 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.303057 Jul 07 07:20:59.916566 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 42/87] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:20:59 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:20:59.949933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1a0a3c6d-8279-4361-a12f-58675db513ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:20:59.958253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1a0a3c6d-8279-4361-a12f-58675db513ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.261681 Jul 07 07:20:59.959244 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 46/88] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:20:59 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:00.236067 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-50acfa05-95aa-4556-84ea-d3b690d87505 req-a3aea3bd-346c-4bea-adad-b3e706ba8448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3f12d6-445b-459b-b4be-a6cb33e08ad5", "name": "network-vif-plugged", "status": "completed", "tag": "62ba87a0-ac1a-413f-a251-9750b64de7da"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:00.251378 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-50acfa05-95aa-4556-84ea-d3b690d87505 req-a3aea3bd-346c-4bea-adad-b3e706ba8448 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:00.252032 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-50acfa05-95aa-4556-84ea-d3b690d87505 req-a3aea3bd-346c-4bea-adad-b3e706ba8448 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:00.269607 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-50acfa05-95aa-4556-84ea-d3b690d87505 req-a3aea3bd-346c-4bea-adad-b3e706ba8448 service nova] Creating event network-vif-plugged:62ba87a0-ac1a-413f-a251-9750b64de7da for instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 on hv-cinder-82660 Jul 07 07:21:00.295996 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-50acfa05-95aa-4556-84ea-d3b690d87505 req-a3aea3bd-346c-4bea-adad-b3e706ba8448 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064276 Jul 07 07:21:00.297059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 43/89] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:00.506555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-459be4d9-36bf-49a5-9e8e-b2eb3c776384 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:00.506555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-459be4d9-36bf-49a5-9e8e-b2eb3c776384 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:00.515471 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-459be4d9-36bf-49a5-9e8e-b2eb3c776384 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:00.517142 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-459be4d9-36bf-49a5-9e8e-b2eb3c776384 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:00.520255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-459be4d9-36bf-49a5-9e8e-b2eb3c776384 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:00.521259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-459be4d9-36bf-49a5-9e8e-b2eb3c776384 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:00.596632 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-54fa31c9-2911-4df8-8280-2ba185309c83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:00.597539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-54fa31c9-2911-4df8-8280-2ba185309c83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:00.609800 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54fa31c9-2911-4df8-8280-2ba185309c83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:00.610251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54fa31c9-2911-4df8-8280-2ba185309c83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:00.613184 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54fa31c9-2911-4df8-8280-2ba185309c83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:00.613816 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54fa31c9-2911-4df8-8280-2ba185309c83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:00.825942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-459be4d9-36bf-49a5-9e8e-b2eb3c776384 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:00.836565 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-459be4d9-36bf-49a5-9e8e-b2eb3c776384 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.346096 Jul 07 07:21:00.837553 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 47/90] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:00 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:00.878113 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-54fa31c9-2911-4df8-8280-2ba185309c83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:00.894245 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-54fa31c9-2911-4df8-8280-2ba185309c83 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1361 microversion: 2.1 time: 0.302111 Jul 07 07:21:00.905572 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 44/91] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:00 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:00.935064 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-389ed000-edcb-4994-8b61-0d4e685aed3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:00.936681 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-389ed000-edcb-4994-8b61-0d4e685aed3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:00.948246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-389ed000-edcb-4994-8b61-0d4e685aed3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:00.953092 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-389ed000-edcb-4994-8b61-0d4e685aed3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:00.954218 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-389ed000-edcb-4994-8b61-0d4e685aed3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:00.954671 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-389ed000-edcb-4994-8b61-0d4e685aed3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:00.994214 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e81fdc01-c8b7-429c-8029-53ce7b016fcb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:00.998425 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e81fdc01-c8b7-429c-8029-53ce7b016fcb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:01.013423 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e81fdc01-c8b7-429c-8029-53ce7b016fcb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:01.015043 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e81fdc01-c8b7-429c-8029-53ce7b016fcb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:01.016989 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e81fdc01-c8b7-429c-8029-53ce7b016fcb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:01.018907 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e81fdc01-c8b7-429c-8029-53ce7b016fcb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:01.276148 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-389ed000-edcb-4994-8b61-0d4e685aed3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:01.279792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:01.292945 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-389ed000-edcb-4994-8b61-0d4e685aed3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:01.296729 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-389ed000-edcb-4994-8b61-0d4e685aed3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:01.299372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-389ed000-edcb-4994-8b61-0d4e685aed3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.368057 Jul 07 07:21:01.302158 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 48/92] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:21:00 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:21:01.347761 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e81fdc01-c8b7-429c-8029-53ce7b016fcb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:01.358190 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e81fdc01-c8b7-429c-8029-53ce7b016fcb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.375982 Jul 07 07:21:01.359217 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 45/93] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:00 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:01.756320 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-654173055", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "networks": [{"uuid": "fa4f9607-ad0d-41c7-bf38-9c54623b6b3d"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:01.827818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] validate_networks() for [('fa4f9607-ad0d-41c7-bf38-9c54623b6b3d', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:21:01.855287 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2ae22a93-51f8-4d7d-a29c-321bdbd11aa2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:01.856557 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2ae22a93-51f8-4d7d-a29c-321bdbd11aa2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:01.864274 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ae22a93-51f8-4d7d-a29c-321bdbd11aa2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:01.865430 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ae22a93-51f8-4d7d-a29c-321bdbd11aa2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:01.866725 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ae22a93-51f8-4d7d-a29c-321bdbd11aa2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:01.867516 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ae22a93-51f8-4d7d-a29c-321bdbd11aa2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.122552 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2ae22a93-51f8-4d7d-a29c-321bdbd11aa2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:02.142703 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2ae22a93-51f8-4d7d-a29c-321bdbd11aa2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1314 microversion: 2.1 time: 0.292262 Jul 07 07:21:02.145730 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 46/94] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:01 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:02.155499 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-825f95dc-8b7b-43c3-9a99-7d427e6cf45b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:02.157927 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-825f95dc-8b7b-43c3-9a99-7d427e6cf45b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:02.167813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-825f95dc-8b7b-43c3-9a99-7d427e6cf45b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.168247 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-825f95dc-8b7b-43c3-9a99-7d427e6cf45b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.169269 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-825f95dc-8b7b-43c3-9a99-7d427e6cf45b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.169846 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-825f95dc-8b7b-43c3-9a99-7d427e6cf45b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.465921 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-825f95dc-8b7b-43c3-9a99-7d427e6cf45b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:02.475611 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:02.479101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-825f95dc-8b7b-43c3-9a99-7d427e6cf45b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1547 microversion: 2.1 time: 0.330308 Jul 07 07:21:02.480525 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 47/95] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:02 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1547 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:02.487207 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ec772ed8-096b-4b63-a184-f420221817d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:02.488189 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ec772ed8-096b-4b63-a184-f420221817d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:02.496988 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec772ed8-096b-4b63-a184-f420221817d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.497853 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec772ed8-096b-4b63-a184-f420221817d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.498971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec772ed8-096b-4b63-a184-f420221817d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.499640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ec772ed8-096b-4b63-a184-f420221817d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.536260 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:21:02.536727 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:21:02.537209 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:21:02.537648 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:21:02.538108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:21:02.554798 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.555226 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.561146 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.561875 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.614017 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Getting quotas for project 559507d94a984b9f9663ed9f127668fb. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:21:02.624179 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Getting quotas for user 2e6e49df0e254b4284950e4bbe65ab45 and project 559507d94a984b9f9663ed9f127668fb. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:21:02.639142 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:21:02.642030 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:21:02.748638 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fedfc1a2-df9d-4b96-84fd-241cba21aa7d tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995843 Jul 07 07:21:02.750568 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 49/96] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:21:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:21:02.755395 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-861aaf72-23ef-42c4-90e4-f491734efa7b req-ab0b00d2-d8a4-4a9f-929a-fba375195c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f327dd6-9e19-4aa6-bdb1-7706c651c08c", "name": "network-vif-plugged", "status": "completed", "tag": "a0f4f29b-0ccc-4bff-bdf2-1469d945011f"}, {"server_uuid": "5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c", "name": "network-vif-plugged", "status": "completed", "tag": "7d78694f-a735-488f-84c8-ca44f4d7aba7"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:02.786661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ec772ed8-096b-4b63-a184-f420221817d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:02.797847 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-861aaf72-23ef-42c4-90e4-f491734efa7b req-ab0b00d2-d8a4-4a9f-929a-fba375195c77 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.798287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-861aaf72-23ef-42c4-90e4-f491734efa7b req-ab0b00d2-d8a4-4a9f-929a-fba375195c77 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.821080 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ec772ed8-096b-4b63-a184-f420221817d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:02.826515 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ec772ed8-096b-4b63-a184-f420221817d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:02.827710 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ec772ed8-096b-4b63-a184-f420221817d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.345833 Jul 07 07:21:02.828287 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 48/97] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:21:02 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:21:02.845392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ca4f83d4-8505-406c-9d23-03ad611a6e3d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:02.846010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ca4f83d4-8505-406c-9d23-03ad611a6e3d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:02.848643 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-861aaf72-23ef-42c4-90e4-f491734efa7b req-ab0b00d2-d8a4-4a9f-929a-fba375195c77 service nova] Creating event network-vif-plugged:a0f4f29b-0ccc-4bff-bdf2-1469d945011f for instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c on hv-cinder-82660 Jul 07 07:21:02.850474 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-861aaf72-23ef-42c4-90e4-f491734efa7b req-ab0b00d2-d8a4-4a9f-929a-fba375195c77 service nova] Creating event network-vif-plugged:7d78694f-a735-488f-84c8-ca44f4d7aba7 for instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c on hv-cinder-82660 Jul 07 07:21:02.864929 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca4f83d4-8505-406c-9d23-03ad611a6e3d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.865432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca4f83d4-8505-406c-9d23-03ad611a6e3d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.866202 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca4f83d4-8505-406c-9d23-03ad611a6e3d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.866632 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca4f83d4-8505-406c-9d23-03ad611a6e3d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.872094 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-861aaf72-23ef-42c4-90e4-f491734efa7b req-ab0b00d2-d8a4-4a9f-929a-fba375195c77 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.120109 Jul 07 07:21:02.883534 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 50/98] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:02.895245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e32838be-2f32-40c8-b80e-e236bc494abb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:02.895840 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e32838be-2f32-40c8-b80e-e236bc494abb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:02.922237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e32838be-2f32-40c8-b80e-e236bc494abb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.922693 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e32838be-2f32-40c8-b80e-e236bc494abb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:02.923482 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e32838be-2f32-40c8-b80e-e236bc494abb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:02.923913 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e32838be-2f32-40c8-b80e-e236bc494abb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:03.253983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e32838be-2f32-40c8-b80e-e236bc494abb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.366809 Jul 07 07:21:03.254908 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 51/99] 10.222.0.62 () {58 vars in 1274 bytes} [Thu Jul 7 07:21:02 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/os-interface => generated 284 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:03.268661 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b929d80c-a6a8-422b-9a45-4be18304689c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:03.271150 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b929d80c-a6a8-422b-9a45-4be18304689c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:03.499476 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b929d80c-a6a8-422b-9a45-4be18304689c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:03.507391 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b929d80c-a6a8-422b-9a45-4be18304689c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1213 microversion: 2.1 time: 0.243868 Jul 07 07:21:03.508251 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 52/100] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:03 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1213 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:03.513354 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cb9bdb5f-195e-413d-a715-d800a28893c8 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:03.514183 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cb9bdb5f-195e-413d-a715-d800a28893c8 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:03.522213 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb9bdb5f-195e-413d-a715-d800a28893c8 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:03.523000 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb9bdb5f-195e-413d-a715-d800a28893c8 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:03.524255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb9bdb5f-195e-413d-a715-d800a28893c8 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:03.525037 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cb9bdb5f-195e-413d-a715-d800a28893c8 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:03.534673 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ca4f83d4-8505-406c-9d23-03ad611a6e3d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:03.550566 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ca4f83d4-8505-406c-9d23-03ad611a6e3d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.713453 Jul 07 07:21:03.551838 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 49/101] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:02 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:03.855686 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-deb0feb6-493c-48bf-8460-e5b453fbd7bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:03.861015 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-deb0feb6-493c-48bf-8460-e5b453fbd7bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:03.877528 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-deb0feb6-493c-48bf-8460-e5b453fbd7bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:03.879106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-deb0feb6-493c-48bf-8460-e5b453fbd7bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:03.881461 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-deb0feb6-493c-48bf-8460-e5b453fbd7bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:03.883268 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-deb0feb6-493c-48bf-8460-e5b453fbd7bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:04.193773 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cb9bdb5f-195e-413d-a715-d800a28893c8 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:04.204554 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cb9bdb5f-195e-413d-a715-d800a28893c8 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1502 microversion: 2.1 time: 0.694884 Jul 07 07:21:04.204987 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 53/102] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:03 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1502 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:04.382119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-deb0feb6-493c-48bf-8460-e5b453fbd7bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:04.397096 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-deb0feb6-493c-48bf-8460-e5b453fbd7bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:04.398790 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-deb0feb6-493c-48bf-8460-e5b453fbd7bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:04.399972 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-deb0feb6-493c-48bf-8460-e5b453fbd7bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1405 microversion: 2.20 time: 0.556509 Jul 07 07:21:04.400878 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 50/103] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:21:03 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1405 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:21:04.544834 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e6493bfc-e64c-4795-a23a-809b2a4cdecd tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:04.546756 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e6493bfc-e64c-4795-a23a-809b2a4cdecd tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:04.559612 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6493bfc-e64c-4795-a23a-809b2a4cdecd tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:04.560694 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6493bfc-e64c-4795-a23a-809b2a4cdecd tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:04.563963 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6493bfc-e64c-4795-a23a-809b2a4cdecd tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:04.563963 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e6493bfc-e64c-4795-a23a-809b2a4cdecd tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:04.569437 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-31f5386c-5844-4e70-9307-570500227f6e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:04.570210 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-31f5386c-5844-4e70-9307-570500227f6e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:04.584215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31f5386c-5844-4e70-9307-570500227f6e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:04.584906 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31f5386c-5844-4e70-9307-570500227f6e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:04.585946 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31f5386c-5844-4e70-9307-570500227f6e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:04.586584 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-31f5386c-5844-4e70-9307-570500227f6e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:04.948110 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e6493bfc-e64c-4795-a23a-809b2a4cdecd tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:04.958229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e6493bfc-e64c-4795-a23a-809b2a4cdecd tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1209 microversion: 2.1 time: 0.425381 Jul 07 07:21:04.959399 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 54/104] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:04 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1209 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:05.171220 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-31f5386c-5844-4e70-9307-570500227f6e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:05.182283 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-31f5386c-5844-4e70-9307-570500227f6e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.616576 Jul 07 07:21:05.183157 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 51/105] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:04 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:05.419471 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d3abf840-8200-4169-b28f-e83cc890f359 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:05.420782 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d3abf840-8200-4169-b28f-e83cc890f359 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:05.428579 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3abf840-8200-4169-b28f-e83cc890f359 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:05.428985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3abf840-8200-4169-b28f-e83cc890f359 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:05.429998 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3abf840-8200-4169-b28f-e83cc890f359 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:05.430413 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d3abf840-8200-4169-b28f-e83cc890f359 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:05.720044 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d3abf840-8200-4169-b28f-e83cc890f359 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:05.731601 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d3abf840-8200-4169-b28f-e83cc890f359 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:05.733593 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d3abf840-8200-4169-b28f-e83cc890f359 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:05.736033 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d3abf840-8200-4169-b28f-e83cc890f359 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1596 microversion: 2.20 time: 0.320479 Jul 07 07:21:05.737320 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 55/106] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:21:05 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1596 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:21:05.756447 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9d4c6591-1682-4f9c-969f-2a611f3617d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:05.757821 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9d4c6591-1682-4f9c-969f-2a611f3617d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:05.765098 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9d4c6591-1682-4f9c-969f-2a611f3617d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:05.765956 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9d4c6591-1682-4f9c-969f-2a611f3617d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:05.766983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9d4c6591-1682-4f9c-969f-2a611f3617d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:05.767616 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9d4c6591-1682-4f9c-969f-2a611f3617d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:05.806659 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-610845b6-7456-495d-9ec2-c9a31c5bdcc5 req-6ae25b59-b2c2-4d19-9411-74b689ccc4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec188266-15a7-4559-ab29-6025dd7837e5", "tag": "11de54d7-a166-4f12-8b83-93407305355c"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:05.818006 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-610845b6-7456-495d-9ec2-c9a31c5bdcc5 req-6ae25b59-b2c2-4d19-9411-74b689ccc4db service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:05.818801 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-610845b6-7456-495d-9ec2-c9a31c5bdcc5 req-6ae25b59-b2c2-4d19-9411-74b689ccc4db service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:05.837737 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-610845b6-7456-495d-9ec2-c9a31c5bdcc5 req-6ae25b59-b2c2-4d19-9411-74b689ccc4db service nova] Creating event network-changed:11de54d7-a166-4f12-8b83-93407305355c for instance ec188266-15a7-4559-ab29-6025dd7837e5 on hv-cinder-82660 Jul 07 07:21:05.843717 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-610845b6-7456-495d-9ec2-c9a31c5bdcc5 req-6ae25b59-b2c2-4d19-9411-74b689ccc4db service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041587 Jul 07 07:21:05.848009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 56/107] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:21:05.937169 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9d4c6591-1682-4f9c-969f-2a611f3617d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.186005 Jul 07 07:21:05.938268 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 52/108] 10.222.0.62 () {60 vars in 1315 bytes} [Thu Jul 7 07:21:05 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-interface => generated 284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 07:21:05.989205 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a4a43628-df39-48a9-bd0a-e5a85701e730 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:05.990476 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a4a43628-df39-48a9-bd0a-e5a85701e730 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:06.000100 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4a43628-df39-48a9-bd0a-e5a85701e730 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:06.007706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1b604531-ed39-49b5-8dd5-d9a5108aa9f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ad084ba-64f2-4b4e-8fe7-2a171b3bf165"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:06.009407 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1b604531-ed39-49b5-8dd5-d9a5108aa9f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:06.013812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4a43628-df39-48a9-bd0a-e5a85701e730 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:06.017105 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4a43628-df39-48a9-bd0a-e5a85701e730 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:06.019579 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4a43628-df39-48a9-bd0a-e5a85701e730 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:06.028652 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b604531-ed39-49b5-8dd5-d9a5108aa9f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:06.030518 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b604531-ed39-49b5-8dd5-d9a5108aa9f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:06.034070 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b604531-ed39-49b5-8dd5-d9a5108aa9f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:06.034827 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1b604531-ed39-49b5-8dd5-d9a5108aa9f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:06.184012 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a4a43628-df39-48a9-bd0a-e5a85701e730 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:06.198407 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a4a43628-df39-48a9-bd0a-e5a85701e730 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1265 microversion: 2.1 time: 0.215247 Jul 07 07:21:06.226544 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 57/109] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:05 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:06.276812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0251f81c-bc4a-4170-84d3-b06ec6ea3b66 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:06.277593 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0251f81c-bc4a-4170-84d3-b06ec6ea3b66 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:06.295490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0251f81c-bc4a-4170-84d3-b06ec6ea3b66 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:06.296167 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0251f81c-bc4a-4170-84d3-b06ec6ea3b66 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:06.297281 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0251f81c-bc4a-4170-84d3-b06ec6ea3b66 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:06.301031 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0251f81c-bc4a-4170-84d3-b06ec6ea3b66 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:06.660155 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0251f81c-bc4a-4170-84d3-b06ec6ea3b66 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:06.669526 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0251f81c-bc4a-4170-84d3-b06ec6ea3b66 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1367 microversion: 2.1 time: 0.440280 Jul 07 07:21:06.684217 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 58/110] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:06 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:07.229024 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1b604531-ed39-49b5-8dd5-d9a5108aa9f2 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "POST /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.220679 Jul 07 07:21:07.231652 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 53/111] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:21:06 2022] POST /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5/os-volume_attachments => generated 194 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:07.241633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4a90b33e-2d76-494a-8127-28ed5f82d20a tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:07.242424 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4a90b33e-2d76-494a-8127-28ed5f82d20a tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:07.251033 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a90b33e-2d76-494a-8127-28ed5f82d20a tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:07.252223 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a90b33e-2d76-494a-8127-28ed5f82d20a tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:07.253201 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a90b33e-2d76-494a-8127-28ed5f82d20a tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:07.253775 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a90b33e-2d76-494a-8127-28ed5f82d20a tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:07.394701 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4a90b33e-2d76-494a-8127-28ed5f82d20a tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:07.420107 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4a90b33e-2d76-494a-8127-28ed5f82d20a tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1271 microversion: 2.1 time: 0.182604 Jul 07 07:21:07.421282 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 59/112] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:07 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1271 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:07.691931 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9acdf2ab-7a26-4277-ba4b-ca028663fe22 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:07.692669 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9acdf2ab-7a26-4277-ba4b-ca028663fe22 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:07.704790 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9acdf2ab-7a26-4277-ba4b-ca028663fe22 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:07.707765 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9acdf2ab-7a26-4277-ba4b-ca028663fe22 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:07.710166 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9acdf2ab-7a26-4277-ba4b-ca028663fe22 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:07.711049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9acdf2ab-7a26-4277-ba4b-ca028663fe22 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:08.380973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9acdf2ab-7a26-4277-ba4b-ca028663fe22 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:08.412606 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9acdf2ab-7a26-4277-ba4b-ca028663fe22 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1556 microversion: 2.1 time: 0.726157 Jul 07 07:21:08.421249 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 54/113] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:07 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1556 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:08.446375 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-661f8fe6-b47b-4642-ab9e-acb179215cc0 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:08.447006 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-661f8fe6-b47b-4642-ab9e-acb179215cc0 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:08.455085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6c54d9ea-1609-447c-9142-8a372fba4085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:08.455922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6c54d9ea-1609-447c-9142-8a372fba4085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:08.461317 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-661f8fe6-b47b-4642-ab9e-acb179215cc0 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:08.461766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-661f8fe6-b47b-4642-ab9e-acb179215cc0 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:08.463055 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-661f8fe6-b47b-4642-ab9e-acb179215cc0 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:08.466992 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-661f8fe6-b47b-4642-ab9e-acb179215cc0 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:08.467387 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c54d9ea-1609-447c-9142-8a372fba4085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:08.468581 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c54d9ea-1609-447c-9142-8a372fba4085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:08.470389 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c54d9ea-1609-447c-9142-8a372fba4085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:08.471687 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c54d9ea-1609-447c-9142-8a372fba4085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:08.617606 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-661f8fe6-b47b-4642-ab9e-acb179215cc0 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:08.646865 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-661f8fe6-b47b-4642-ab9e-acb179215cc0 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1271 microversion: 2.1 time: 0.204499 Jul 07 07:21:08.647475 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 55/114] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:08 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:08.656917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6c54d9ea-1609-447c-9142-8a372fba4085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217285 Jul 07 07:21:08.667102 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 60/115] 10.222.0.62 () {58 vars in 1274 bytes} [Thu Jul 7 07:21:08 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:09.680063 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-701b9f33-c556-4d25-a27d-009e336b73ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:09.680865 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-701b9f33-c556-4d25-a27d-009e336b73ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:09.695049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-701b9f33-c556-4d25-a27d-009e336b73ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:09.695486 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-701b9f33-c556-4d25-a27d-009e336b73ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:09.699090 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-701b9f33-c556-4d25-a27d-009e336b73ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:09.699787 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-701b9f33-c556-4d25-a27d-009e336b73ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:10.107601 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-b73a22fa-b5f5-489e-aa66-f708acd38815 req-ed2a3573-28d0-40ad-80b5-11bd411b79c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c", "tag": "7d78694f-a735-488f-84c8-ca44f4d7aba7"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:10.130258 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b73a22fa-b5f5-489e-aa66-f708acd38815 req-ed2a3573-28d0-40ad-80b5-11bd411b79c5 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:10.130708 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b73a22fa-b5f5-489e-aa66-f708acd38815 req-ed2a3573-28d0-40ad-80b5-11bd411b79c5 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:10.161679 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-b73a22fa-b5f5-489e-aa66-f708acd38815 req-ed2a3573-28d0-40ad-80b5-11bd411b79c5 service nova] Creating event network-changed:7d78694f-a735-488f-84c8-ca44f4d7aba7 for instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c on hv-cinder-82660 Jul 07 07:21:10.168160 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-b73a22fa-b5f5-489e-aa66-f708acd38815 req-ed2a3573-28d0-40ad-80b5-11bd411b79c5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064163 Jul 07 07:21:10.170575 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 61/116] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:21:10.175727 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-701b9f33-c556-4d25-a27d-009e336b73ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:10.190990 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-701b9f33-c556-4d25-a27d-009e336b73ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.517601 Jul 07 07:21:10.193577 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 56/117] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:09 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:10.995789 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-abc6690a-3f5e-4c39-91af-cbf222b96240 req-19322f20-7c01-482c-a75d-bf1e59f99c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f327dd6-9e19-4aa6-bdb1-7706c651c08c", "tag": "a0f4f29b-0ccc-4bff-bdf2-1469d945011f"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:11.010707 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-abc6690a-3f5e-4c39-91af-cbf222b96240 req-19322f20-7c01-482c-a75d-bf1e59f99c72 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:11.011359 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-abc6690a-3f5e-4c39-91af-cbf222b96240 req-19322f20-7c01-482c-a75d-bf1e59f99c72 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:11.042469 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-abc6690a-3f5e-4c39-91af-cbf222b96240 req-19322f20-7c01-482c-a75d-bf1e59f99c72 service nova] Creating event network-changed:a0f4f29b-0ccc-4bff-bdf2-1469d945011f for instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c on hv-cinder-82660 Jul 07 07:21:11.059289 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-abc6690a-3f5e-4c39-91af-cbf222b96240 req-19322f20-7c01-482c-a75d-bf1e59f99c72 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068006 Jul 07 07:21:11.063327 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 62/118] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:11.213270 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-59167aa6-545b-40ae-a043-148751d69e97 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:11.215224 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-59167aa6-545b-40ae-a043-148751d69e97 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:11.226916 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59167aa6-545b-40ae-a043-148751d69e97 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:11.243556 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59167aa6-545b-40ae-a043-148751d69e97 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:11.253914 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59167aa6-545b-40ae-a043-148751d69e97 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:11.254495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59167aa6-545b-40ae-a043-148751d69e97 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:11.969783 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-59167aa6-545b-40ae-a043-148751d69e97 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:11.985679 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-59167aa6-545b-40ae-a043-148751d69e97 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.778935 Jul 07 07:21:11.999748 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 57/119] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:11 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:12.375164 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-24f974ab-9475-4af3-ae9d-d0d012816b91 req-66860eec-5b34-4d94-8c26-b2ffe34e2ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb98b1db-9890-4e5a-a284-ebc2f14b3fe1", "tag": "d8a678da-b9ea-4fd2-98e0-58939966b65d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:12.393314 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-24f974ab-9475-4af3-ae9d-d0d012816b91 req-66860eec-5b34-4d94-8c26-b2ffe34e2ce5 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:12.394062 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-24f974ab-9475-4af3-ae9d-d0d012816b91 req-66860eec-5b34-4d94-8c26-b2ffe34e2ce5 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:12.414145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-24f974ab-9475-4af3-ae9d-d0d012816b91 req-66860eec-5b34-4d94-8c26-b2ffe34e2ce5 service nova] Creating event network-changed:d8a678da-b9ea-4fd2-98e0-58939966b65d for instance eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 on hv-cinder-82660 Jul 07 07:21:12.420521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-24f974ab-9475-4af3-ae9d-d0d012816b91 req-66860eec-5b34-4d94-8c26-b2ffe34e2ce5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050648 Jul 07 07:21:12.421806 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 63/120] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:13.006039 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-db461a85-5289-4b76-a2f4-1c7ac4c639fc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:13.007381 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-db461a85-5289-4b76-a2f4-1c7ac4c639fc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:13.020817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-db461a85-5289-4b76-a2f4-1c7ac4c639fc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:13.021655 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-db461a85-5289-4b76-a2f4-1c7ac4c639fc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:13.022673 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-db461a85-5289-4b76-a2f4-1c7ac4c639fc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:13.023335 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-db461a85-5289-4b76-a2f4-1c7ac4c639fc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:13.647715 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-db461a85-5289-4b76-a2f4-1c7ac4c639fc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:13.686212 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-db461a85-5289-4b76-a2f4-1c7ac4c639fc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.684015 Jul 07 07:21:13.686846 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 58/121] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:13 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:14.702407 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:14.703325 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=8 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:14.707856 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0b5e989a-f85f-4ca4-8564-ecd56958edba tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:14.708619 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0b5e989a-f85f-4ca4-8564-ecd56958edba tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:14.716535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b5e989a-f85f-4ca4-8564-ecd56958edba tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:14.716987 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b5e989a-f85f-4ca4-8564-ecd56958edba tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:14.717797 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b5e989a-f85f-4ca4-8564-ecd56958edba tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:14.718237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0b5e989a-f85f-4ca4-8564-ecd56958edba tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:14.888932 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0b5e989a-f85f-4ca4-8564-ecd56958edba tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:14.905486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0b5e989a-f85f-4ca4-8564-ecd56958edba tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.203705 Jul 07 07:21:14.917661 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 64/122] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:14 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:15.926280 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d09d26af-681f-462b-b757-ade932f4f9d8 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:15.926909 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d09d26af-681f-462b-b757-ade932f4f9d8 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:15.941252 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d09d26af-681f-462b-b757-ade932f4f9d8 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:15.941970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d09d26af-681f-462b-b757-ade932f4f9d8 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:15.943079 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d09d26af-681f-462b-b757-ade932f4f9d8 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:15.943764 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d09d26af-681f-462b-b757-ade932f4f9d8 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:16.126165 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d09d26af-681f-462b-b757-ade932f4f9d8 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:16.139171 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d09d26af-681f-462b-b757-ade932f4f9d8 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.218186 Jul 07 07:21:16.142408 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 59/123] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:15 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:16.563306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0fe8a17a-325f-4724-915f-7d8bbe429176 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:16.564232 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0fe8a17a-325f-4724-915f-7d8bbe429176 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:16.570833 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0fe8a17a-325f-4724-915f-7d8bbe429176 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:16.571284 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0fe8a17a-325f-4724-915f-7d8bbe429176 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:16.572055 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0fe8a17a-325f-4724-915f-7d8bbe429176 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:16.572492 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0fe8a17a-325f-4724-915f-7d8bbe429176 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:16.598074 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0fe8a17a-325f-4724-915f-7d8bbe429176 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:21:16.700391 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0fe8a17a-325f-4724-915f-7d8bbe429176 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 204 len: 0 microversion: 2.1 time: 0.141084 Jul 07 07:21:16.701200 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 65/124] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:21:16 2022] DELETE /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:21:16.710010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5eee94f6-2cab-43e1-9006-591025aacfce tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:16.711054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5eee94f6-2cab-43e1-9006-591025aacfce tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:16.717659 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5eee94f6-2cab-43e1-9006-591025aacfce tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:16.718108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5eee94f6-2cab-43e1-9006-591025aacfce tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:16.718867 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5eee94f6-2cab-43e1-9006-591025aacfce tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:16.719291 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5eee94f6-2cab-43e1-9006-591025aacfce tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:16.855657 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5eee94f6-2cab-43e1-9006-591025aacfce tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:16.864031 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5eee94f6-2cab-43e1-9006-591025aacfce tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1554 microversion: 2.1 time: 0.158007 Jul 07 07:21:16.864690 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 60/125] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:16 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:17.159936 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-916ac50e-fa18-4471-85b5-81797082ce4c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:17.160643 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-916ac50e-fa18-4471-85b5-81797082ce4c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:17.171740 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-916ac50e-fa18-4471-85b5-81797082ce4c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:17.172278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-916ac50e-fa18-4471-85b5-81797082ce4c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:17.172990 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-916ac50e-fa18-4471-85b5-81797082ce4c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:17.173466 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-916ac50e-fa18-4471-85b5-81797082ce4c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:17.335741 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-916ac50e-fa18-4471-85b5-81797082ce4c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:17.343517 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-916ac50e-fa18-4471-85b5-81797082ce4c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.187977 Jul 07 07:21:17.344099 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 66/126] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:17 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:17.883919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-43841710-6e44-4d37-827b-2a654e5ed605 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:17.884490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-43841710-6e44-4d37-827b-2a654e5ed605 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:17.891985 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=76 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:17.894828 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43841710-6e44-4d37-827b-2a654e5ed605 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:17.895439 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43841710-6e44-4d37-827b-2a654e5ed605 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:17.896318 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43841710-6e44-4d37-827b-2a654e5ed605 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:17.896811 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43841710-6e44-4d37-827b-2a654e5ed605 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:18.044922 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-43841710-6e44-4d37-827b-2a654e5ed605 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:18.053774 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-43841710-6e44-4d37-827b-2a654e5ed605 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1554 microversion: 2.1 time: 0.174308 Jul 07 07:21:18.054388 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 61/127] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:17 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:18.361386 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9041b39d-51fc-4fdf-ac99-6eba837c1470 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:18.362060 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9041b39d-51fc-4fdf-ac99-6eba837c1470 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:18.368976 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9041b39d-51fc-4fdf-ac99-6eba837c1470 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:18.369466 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9041b39d-51fc-4fdf-ac99-6eba837c1470 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:18.370306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9041b39d-51fc-4fdf-ac99-6eba837c1470 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:18.370749 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9041b39d-51fc-4fdf-ac99-6eba837c1470 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:18.511577 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9041b39d-51fc-4fdf-ac99-6eba837c1470 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:18.519711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9041b39d-51fc-4fdf-ac99-6eba837c1470 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.162629 Jul 07 07:21:18.520299 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 67/128] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:18 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:19.071474 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fc7f6edf-f65d-43b4-932d-4ba9363c6d69 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:19.072069 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fc7f6edf-f65d-43b4-932d-4ba9363c6d69 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:19.078874 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fc7f6edf-f65d-43b4-932d-4ba9363c6d69 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:19.079332 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fc7f6edf-f65d-43b4-932d-4ba9363c6d69 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:19.080106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fc7f6edf-f65d-43b4-932d-4ba9363c6d69 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:19.080541 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fc7f6edf-f65d-43b4-932d-4ba9363c6d69 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:19.226724 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fc7f6edf-f65d-43b4-932d-4ba9363c6d69 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:19.235367 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fc7f6edf-f65d-43b4-932d-4ba9363c6d69 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1554 microversion: 2.1 time: 0.167845 Jul 07 07:21:19.235959 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 62/129] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:19 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:19.539445 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7e8328ca-8155-4660-8b3e-1dc0a4a0cde4 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:19.540063 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7e8328ca-8155-4660-8b3e-1dc0a4a0cde4 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:19.546674 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e8328ca-8155-4660-8b3e-1dc0a4a0cde4 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:19.547125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e8328ca-8155-4660-8b3e-1dc0a4a0cde4 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:19.547882 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e8328ca-8155-4660-8b3e-1dc0a4a0cde4 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:19.548290 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e8328ca-8155-4660-8b3e-1dc0a4a0cde4 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:19.692534 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7e8328ca-8155-4660-8b3e-1dc0a4a0cde4 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:19.700249 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7e8328ca-8155-4660-8b3e-1dc0a4a0cde4 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.164774 Jul 07 07:21:19.700834 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 68/130] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:19 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:20.255575 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f33f8505-7b4b-4a3b-a276-7ea61c926bee tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:20.256153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f33f8505-7b4b-4a3b-a276-7ea61c926bee tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:20.266406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f33f8505-7b4b-4a3b-a276-7ea61c926bee tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:20.266888 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f33f8505-7b4b-4a3b-a276-7ea61c926bee tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:20.268027 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f33f8505-7b4b-4a3b-a276-7ea61c926bee tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:20.268646 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f33f8505-7b4b-4a3b-a276-7ea61c926bee tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:20.289101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:20.417561 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f33f8505-7b4b-4a3b-a276-7ea61c926bee tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:20.426491 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f33f8505-7b4b-4a3b-a276-7ea61c926bee tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1554 microversion: 2.1 time: 0.177189 Jul 07 07:21:20.427067 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 63/131] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:20 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:20.718383 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e9c433a4-5cdc-467d-a33d-5725e1a9b758 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:20.719031 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e9c433a4-5cdc-467d-a33d-5725e1a9b758 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:20.724993 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c433a4-5cdc-467d-a33d-5725e1a9b758 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:20.725483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c433a4-5cdc-467d-a33d-5725e1a9b758 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:20.726259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c433a4-5cdc-467d-a33d-5725e1a9b758 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:20.726694 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c433a4-5cdc-467d-a33d-5725e1a9b758 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:20.745510 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:20.873111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e9c433a4-5cdc-467d-a33d-5725e1a9b758 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:20.891283 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e9c433a4-5cdc-467d-a33d-5725e1a9b758 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.176552 Jul 07 07:21:20.891899 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 69/132] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:20 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:21.444204 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d23109d8-4800-48fc-9643-3bb642f5129d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:21.444836 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d23109d8-4800-48fc-9643-3bb642f5129d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:21.453513 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d23109d8-4800-48fc-9643-3bb642f5129d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:21.453964 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d23109d8-4800-48fc-9643-3bb642f5129d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:21.454741 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d23109d8-4800-48fc-9643-3bb642f5129d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:21.455168 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d23109d8-4800-48fc-9643-3bb642f5129d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:21.599246 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d23109d8-4800-48fc-9643-3bb642f5129d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:21.607758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d23109d8-4800-48fc-9643-3bb642f5129d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1554 microversion: 2.1 time: 0.167550 Jul 07 07:21:21.608587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 64/133] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:21 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:21.908226 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b32e88b2-ac39-43a0-b125-f52d2ee307e7 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:21.909971 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b32e88b2-ac39-43a0-b125-f52d2ee307e7 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:21.928194 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:21.931240 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b32e88b2-ac39-43a0-b125-f52d2ee307e7 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:21.931836 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b32e88b2-ac39-43a0-b125-f52d2ee307e7 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:21.932825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b32e88b2-ac39-43a0-b125-f52d2ee307e7 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:21.933314 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b32e88b2-ac39-43a0-b125-f52d2ee307e7 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:22.103494 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b32e88b2-ac39-43a0-b125-f52d2ee307e7 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:22.111400 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b32e88b2-ac39-43a0-b125-f52d2ee307e7 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.207160 Jul 07 07:21:22.121088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 70/134] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:21 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:22.378886 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-5395803b-e516-4077-afed-202595beb409 req-8bfad051-d868-451a-a3da-4b89acb991e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3f12d6-445b-459b-b4be-a6cb33e08ad5", "name": "network-vif-deleted", "tag": "62ba87a0-ac1a-413f-a251-9750b64de7da"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:22.392430 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5395803b-e516-4077-afed-202595beb409 req-8bfad051-d868-451a-a3da-4b89acb991e8 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:22.393073 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-5395803b-e516-4077-afed-202595beb409 req-8bfad051-d868-451a-a3da-4b89acb991e8 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:22.411953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-5395803b-e516-4077-afed-202595beb409 req-8bfad051-d868-451a-a3da-4b89acb991e8 service nova] Creating event network-vif-deleted:62ba87a0-ac1a-413f-a251-9750b64de7da for instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 on hv-cinder-82660 Jul 07 07:21:22.418482 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-5395803b-e516-4077-afed-202595beb409 req-8bfad051-d868-451a-a3da-4b89acb991e8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044665 Jul 07 07:21:22.419514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 65/135] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:22.619193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-d7916373-b0f9-4508-8c51-68252a1be31a req-c98fe6ca-1438-4722-9a62-dd8354d8287d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb98b1db-9890-4e5a-a284-ebc2f14b3fe1", "name": "network-vif-plugged", "status": "completed", "tag": "d8a678da-b9ea-4fd2-98e0-58939966b65d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:22.625806 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-198dbc19-a1d0-4f36-a0df-fc2dabb25c6c tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:22.626827 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-198dbc19-a1d0-4f36-a0df-fc2dabb25c6c tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:22.628350 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-d7916373-b0f9-4508-8c51-68252a1be31a req-c98fe6ca-1438-4722-9a62-dd8354d8287d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:22.628727 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-d7916373-b0f9-4508-8c51-68252a1be31a req-c98fe6ca-1438-4722-9a62-dd8354d8287d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:22.634803 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-198dbc19-a1d0-4f36-a0df-fc2dabb25c6c tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:22.635302 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-198dbc19-a1d0-4f36-a0df-fc2dabb25c6c tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:22.636081 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-198dbc19-a1d0-4f36-a0df-fc2dabb25c6c tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:22.636525 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-198dbc19-a1d0-4f36-a0df-fc2dabb25c6c tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:22.640612 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-d7916373-b0f9-4508-8c51-68252a1be31a req-c98fe6ca-1438-4722-9a62-dd8354d8287d service nova] Creating event network-vif-plugged:d8a678da-b9ea-4fd2-98e0-58939966b65d for instance eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 on hv-cinder-82660 Jul 07 07:21:22.646152 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-d7916373-b0f9-4508-8c51-68252a1be31a req-c98fe6ca-1438-4722-9a62-dd8354d8287d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030672 Jul 07 07:21:22.647258 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 71/136] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:22.706567 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-198dbc19-a1d0-4f36-a0df-fc2dabb25c6c tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:22.716271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-198dbc19-a1d0-4f36-a0df-fc2dabb25c6c tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1345 microversion: 2.1 time: 0.094862 Jul 07 07:21:22.716902 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 66/137] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:22 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:23.129013 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-78e59171-7235-4374-8a11-2d76dfc5ba95 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:23.129597 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-78e59171-7235-4374-8a11-2d76dfc5ba95 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:23.136564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78e59171-7235-4374-8a11-2d76dfc5ba95 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:23.137012 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78e59171-7235-4374-8a11-2d76dfc5ba95 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:23.137813 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78e59171-7235-4374-8a11-2d76dfc5ba95 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:23.138249 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-78e59171-7235-4374-8a11-2d76dfc5ba95 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:23.277448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-78e59171-7235-4374-8a11-2d76dfc5ba95 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:23.284963 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-78e59171-7235-4374-8a11-2d76dfc5ba95 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1313 microversion: 2.1 time: 0.160389 Jul 07 07:21:23.288120 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 72/138] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:23 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:23.734952 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:23.735555 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:23.742977 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:23.743431 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:23.744349 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:23.744767 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:23.781250 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:23.781707 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:23.782165 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lazy-loading 'fault' on Instance uuid 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:21:23.827541 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:23.835895 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ebedbbb2-9310-4224-9f4b-c6d725051dc6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1350 microversion: 2.1 time: 0.105612 Jul 07 07:21:23.836478 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 67/139] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:23 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:24.305319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7d27addc-33b4-4b1d-8b41-fc9e39186a9b tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:24.305886 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7d27addc-33b4-4b1d-8b41-fc9e39186a9b tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:24.312835 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d27addc-33b4-4b1d-8b41-fc9e39186a9b tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:24.313358 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d27addc-33b4-4b1d-8b41-fc9e39186a9b tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:24.314257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d27addc-33b4-4b1d-8b41-fc9e39186a9b tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:24.314682 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d27addc-33b4-4b1d-8b41-fc9e39186a9b tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:24.460732 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7d27addc-33b4-4b1d-8b41-fc9e39186a9b tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:24.472275 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7d27addc-33b4-4b1d-8b41-fc9e39186a9b tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1498 microversion: 2.1 time: 0.170689 Jul 07 07:21:24.473135 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 73/140] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:24 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:24.853756 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:24.855135 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:24.878510 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:24.879028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:24.879852 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:24.880300 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:24.925602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:24.926057 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:24.927311 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lazy-loading 'fault' on Instance uuid 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:21:24.987705 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3401cbd655eb4dffb2acb46cfbdd9259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6345958b424ceeb06285db0fc8d877', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:24.996768 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-37afc8dc-8d84-4eb1-982e-7bf00417763f tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 200 len: 1304 microversion: 2.1 time: 0.146914 Jul 07 07:21:24.997427 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 68/141] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:24 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:25.168342 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-88ada251-510a-4cd5-b160-906606610f5f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:25.169333 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-88ada251-510a-4cd5-b160-906606610f5f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:25.176463 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88ada251-510a-4cd5-b160-906606610f5f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:25.176920 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88ada251-510a-4cd5-b160-906606610f5f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:25.177688 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88ada251-510a-4cd5-b160-906606610f5f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:25.178111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88ada251-510a-4cd5-b160-906606610f5f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:25.211474 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-88ada251-510a-4cd5-b160-906606610f5f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:21:25.301661 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-88ada251-510a-4cd5-b160-906606610f5f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 204 len: 0 microversion: 2.1 time: 0.138182 Jul 07 07:21:25.302385 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 74/142] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:21:25 2022] DELETE /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 07 07:21:25.310958 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6b907c94-38b2-42b8-b8c8-78f603b46ae6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:25.311602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6b907c94-38b2-42b8-b8c8-78f603b46ae6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:25.318248 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b907c94-38b2-42b8-b8c8-78f603b46ae6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:25.318695 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b907c94-38b2-42b8-b8c8-78f603b46ae6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:25.319419 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b907c94-38b2-42b8-b8c8-78f603b46ae6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:25.320519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b907c94-38b2-42b8-b8c8-78f603b46ae6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:25.523595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6b907c94-38b2-42b8-b8c8-78f603b46ae6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:25.535251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6b907c94-38b2-42b8-b8c8-78f603b46ae6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1504 microversion: 2.1 time: 0.228148 Jul 07 07:21:25.536136 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 69/143] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:25 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:26.021173 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-026f79f5-d5e3-43e0-8c8c-657c5f0618a5 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:26.021173 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-026f79f5-d5e3-43e0-8c8c-657c5f0618a5 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:26.032245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-026f79f5-d5e3-43e0-8c8c-657c5f0618a5 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:26.032869 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-026f79f5-d5e3-43e0-8c8c-657c5f0618a5 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:26.033746 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-026f79f5-d5e3-43e0-8c8c-657c5f0618a5 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:26.034183 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-026f79f5-d5e3-43e0-8c8c-657c5f0618a5 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:26.050358 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-026f79f5-d5e3-43e0-8c8c-657c5f0618a5 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] HTTP exception thrown: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-026f79f5-d5e3-43e0-8c8c-657c5f0618a5 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Request method failure captured: Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 HTTP/1.1 Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok8HCANU4_VSzUS7v8MufGU_KipyPmDR50mDz_U1xczi3XlwMNAcU9-FhE5K4sIdySIR4YB6m3b9KF53aBVEtsojb-xBsrWf3imhfwldsvqhe3bw-M8zI-ywacyVB61j_U4fzUdQ1XbAO5BjCVIhDe_fL6qLB5eYQ7EQ577-2rk2CI Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 6b6345958b424ceeb06285db0fc8d877 Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:21:26.055138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 6b6345958b424ceeb06285db0fc8d877 Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-DeleteServersTestJSON-1671603328-project Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 3401cbd655eb4dffb2acb46cfbdd9259 Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-DeleteServersTestJSON-1671603328-project Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:26.056426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '3e3f12d6-445b-459b-b4be-a6cb33e08ad5'} Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:21:26.057125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:26.058319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:21:26.059668 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-026f79f5-d5e3-43e0-8c8c-657c5f0618a5 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Returning 404 to user: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:21:26.059668 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-026f79f5-d5e3-43e0-8c8c-657c5f0618a5 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 404 len: 111 microversion: 2.1 time: 0.045478 Jul 07 07:21:26.059668 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 75/144] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:26 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:21:26.175278 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5adae27a-6ea3-41bb-a836-2944d6bcf97b tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:26.177039 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5adae27a-6ea3-41bb-a836-2944d6bcf97b tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:26.191067 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5adae27a-6ea3-41bb-a836-2944d6bcf97b tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:26.192052 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5adae27a-6ea3-41bb-a836-2944d6bcf97b tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:26.192341 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5adae27a-6ea3-41bb-a836-2944d6bcf97b tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:26.192976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5adae27a-6ea3-41bb-a836-2944d6bcf97b tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:26.213978 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-5adae27a-6ea3-41bb-a836-2944d6bcf97b tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] HTTP exception thrown: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5adae27a-6ea3-41bb-a836-2944d6bcf97b tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Request method failure captured: Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5/os-volume_attachments HTTP/1.1 Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixok8HCANU4_VSzUS7v8MufGU_KipyPmDR50mDz_U1xczi3XlwMNAcU9-FhE5K4sIdySIR4YB6m3b9KF53aBVEtsojb-xBsrWf3imhfwldsvqhe3bw-M8zI-ywacyVB61j_U4fzUdQ1XbAO5BjCVIhDe_fL6qLB5eYQ7EQ577-2rk2CI Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 6b6345958b424ceeb06285db0fc8d877 Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:21:26.219017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 6b6345958b424ceeb06285db0fc8d877 Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-DeleteServersTestJSON-1671603328-project Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 3401cbd655eb4dffb2acb46cfbdd9259 Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-DeleteServersTestJSON-1671603328-project Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:26.220560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'server_id': '3e3f12d6-445b-459b-b4be-a6cb33e08ad5'} Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:21:26.221519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:26.222625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:26.224100 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5adae27a-6ea3-41bb-a836-2944d6bcf97b tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Returning 404 to user: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:21:26.224100 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5adae27a-6ea3-41bb-a836-2944d6bcf97b tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050995 Jul 07 07:21:26.226554 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 70/145] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:21:26 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:21:26.557892 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bedbdd0e-5982-4888-8a6f-da29f617f572 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:26.558515 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bedbdd0e-5982-4888-8a6f-da29f617f572 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:26.565451 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bedbdd0e-5982-4888-8a6f-da29f617f572 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:26.565908 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bedbdd0e-5982-4888-8a6f-da29f617f572 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:26.566680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bedbdd0e-5982-4888-8a6f-da29f617f572 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:26.567121 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bedbdd0e-5982-4888-8a6f-da29f617f572 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:26.707336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bedbdd0e-5982-4888-8a6f-da29f617f572 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:26.715879 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bedbdd0e-5982-4888-8a6f-da29f617f572 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1504 microversion: 2.1 time: 0.161791 Jul 07 07:21:26.716486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 76/146] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:26 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:27.482768 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-70314d32-3b78-4e6a-8937-0a90495fc20d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:27.484037 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-70314d32-3b78-4e6a-8937-0a90495fc20d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:27.491661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70314d32-3b78-4e6a-8937-0a90495fc20d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:27.492375 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70314d32-3b78-4e6a-8937-0a90495fc20d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:27.493433 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70314d32-3b78-4e6a-8937-0a90495fc20d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:27.494071 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-70314d32-3b78-4e6a-8937-0a90495fc20d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:27.510312 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-70314d32-3b78-4e6a-8937-0a90495fc20d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] HTTP exception thrown: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-70314d32-3b78-4e6a-8937-0a90495fc20d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Request method failure captured: Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 HTTP/1.1 Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixok8HCANU4_VSzUS7v8MufGU_KipyPmDR50mDz_U1xczi3XlwMNAcU9-FhE5K4sIdySIR4YB6m3b9KF53aBVEtsojb-xBsrWf3imhfwldsvqhe3bw-M8zI-ywacyVB61j_U4fzUdQ1XbAO5BjCVIhDe_fL6qLB5eYQ7EQ577-2rk2CI Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 6b6345958b424ceeb06285db0fc8d877 Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:21:27.512501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 6b6345958b424ceeb06285db0fc8d877 Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-DeleteServersTestJSON-1671603328-project Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 3401cbd655eb4dffb2acb46cfbdd9259 Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-DeleteServersTestJSON-1671603328-project Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:27.513665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '3e3f12d6-445b-459b-b4be-a6cb33e08ad5'} Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:21:27.514403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:27.515574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:27.516683 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-70314d32-3b78-4e6a-8937-0a90495fc20d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Returning 404 to user: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:21:27.516683 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-70314d32-3b78-4e6a-8937-0a90495fc20d tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 404 len: 111 microversion: 2.1 time: 0.038143 Jul 07 07:21:27.517152 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 71/147] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:21:27 2022] DELETE /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:21:27.528526 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8f01368a-cb08-489b-b560-a7af167208c6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:27.529150 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8f01368a-cb08-489b-b560-a7af167208c6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] [instance: 3e3f12d6-445b-459b-b4be-a6cb33e08ad5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:27.535523 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f01368a-cb08-489b-b560-a7af167208c6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:27.535966 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f01368a-cb08-489b-b560-a7af167208c6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:27.536716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f01368a-cb08-489b-b560-a7af167208c6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:27.537146 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8f01368a-cb08-489b-b560-a7af167208c6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:27.551719 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-8f01368a-cb08-489b-b560-a7af167208c6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] HTTP exception thrown: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8f01368a-cb08-489b-b560-a7af167208c6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Request method failure captured: Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 HTTP/1.1 Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok8HCANU4_VSzUS7v8MufGU_KipyPmDR50mDz_U1xczi3XlwMNAcU9-FhE5K4sIdySIR4YB6m3b9KF53aBVEtsojb-xBsrWf3imhfwldsvqhe3bw-M8zI-ywacyVB61j_U4fzUdQ1XbAO5BjCVIhDe_fL6qLB5eYQ7EQ577-2rk2CI Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 6b6345958b424ceeb06285db0fc8d877 Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:21:27.553306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/6b6345958b424ceeb06285db0fc8d877"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 6b6345958b424ceeb06285db0fc8d877 Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-DeleteServersTestJSON-1671603328 Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-DeleteServersTestJSON-1671603328-project Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 3401cbd655eb4dffb2acb46cfbdd9259 Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-DeleteServersTestJSON-1671603328-project Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:27.554771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '3e3f12d6-445b-459b-b4be-a6cb33e08ad5'} Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:21:27.558983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. Jul 07 07:21:27.560047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:21:27.561196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8f01368a-cb08-489b-b560-a7af167208c6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] Returning 404 to user: Instance 3e3f12d6-445b-459b-b4be-a6cb33e08ad5 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:21:27.561196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8f01368a-cb08-489b-b560-a7af167208c6 tempest-DeleteServersTestJSON-1671603328 tempest-DeleteServersTestJSON-1671603328-project] 10.222.0.62 "GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5" status: 404 len: 111 microversion: 2.1 time: 0.033463 Jul 07 07:21:27.561196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 77/148] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:27 2022] GET /compute/v2.1/servers/3e3f12d6-445b-459b-b4be-a6cb33e08ad5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:21:27.733329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2ce578d9-2911-4d51-8c7a-a905e8186abc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:27.733931 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2ce578d9-2911-4d51-8c7a-a905e8186abc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:27.740028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ce578d9-2911-4d51-8c7a-a905e8186abc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:27.740505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ce578d9-2911-4d51-8c7a-a905e8186abc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:27.741300 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ce578d9-2911-4d51-8c7a-a905e8186abc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:27.741730 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ce578d9-2911-4d51-8c7a-a905e8186abc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:27.805521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2ce578d9-2911-4d51-8c7a-a905e8186abc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:27.814000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2ce578d9-2911-4d51-8c7a-a905e8186abc tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 200 len: 1462 microversion: 2.1 time: 0.084531 Jul 07 07:21:27.814584 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 72/149] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:27 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:27.828336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-1549fde7-ac15-446e-925c-acc7262367d8 req-4592ba82-33cf-4b5b-85c7-fbda24164889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb98b1db-9890-4e5a-a284-ebc2f14b3fe1", "name": "network-vif-deleted", "tag": "d8a678da-b9ea-4fd2-98e0-58939966b65d"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:27.838255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-1549fde7-ac15-446e-925c-acc7262367d8 req-4592ba82-33cf-4b5b-85c7-fbda24164889 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:27.838703 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-1549fde7-ac15-446e-925c-acc7262367d8 req-4592ba82-33cf-4b5b-85c7-fbda24164889 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:27.850372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-1549fde7-ac15-446e-925c-acc7262367d8 req-4592ba82-33cf-4b5b-85c7-fbda24164889 service nova] Creating event network-vif-deleted:d8a678da-b9ea-4fd2-98e0-58939966b65d for instance eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 on hv-cinder-82660 Jul 07 07:21:27.855140 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-1549fde7-ac15-446e-925c-acc7262367d8 req-4592ba82-33cf-4b5b-85c7-fbda24164889 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030505 Jul 07 07:21:27.855752 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 78/150] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:28.831588 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1732169b-a816-4ba6-9fac-91c6e5a8a007 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:28.832727 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1732169b-a816-4ba6-9fac-91c6e5a8a007 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: eb98b1db-9890-4e5a-a284-ebc2f14b3fe1] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:28.839526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1732169b-a816-4ba6-9fac-91c6e5a8a007 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:28.840008 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1732169b-a816-4ba6-9fac-91c6e5a8a007 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:28.840771 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1732169b-a816-4ba6-9fac-91c6e5a8a007 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:28.841210 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1732169b-a816-4ba6-9fac-91c6e5a8a007 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:28.856626 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-1732169b-a816-4ba6-9fac-91c6e5a8a007 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] HTTP exception thrown: Instance eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 could not be found. Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1732169b-a816-4ba6-9fac-91c6e5a8a007 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Request method failure captured: Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 HTTP/1.1 Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixolbLwvFkiZmzwiigvQpXO9Ku99o4RqdEDXH3PzV7GXy3uT6nyKECWvWIwXHAynEoq3L0ZWFd0-2dhTuooW5bA5sNdd9gldYLdqnkpuZzXuci9aGDJ5tE0BGZDVzZn4rj2yIQhU35z9XGnEOYjdKttqSmkxdJ_3Pmv3a56g3ntIaR5g Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 559507d94a984b9f9663ed9f127668fb Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesActionsTest-542144810 Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:21:28.858109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/559507d94a984b9f9663ed9f127668fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/559507d94a984b9f9663ed9f127668fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_559507d94a984b9f9663ed9f127668fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/559507d94a984b9f9663ed9f127668fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesActionsTest-542144810 Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 559507d94a984b9f9663ed9f127668fb Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesActionsTest-542144810 Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesActionsTest-542144810-project Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 2e6e49df0e254b4284950e4bbe65ab45 Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesActionsTest-542144810-project Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 could not be found. Jul 07 07:21:28.859405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': 'eb98b1db-9890-4e5a-a284-ebc2f14b3fe1'} Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 could not be found. Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:21:28.860237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 could not be found. Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 could not be found. Jul 07 07:21:28.861509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:21:28.862677 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1732169b-a816-4ba6-9fac-91c6e5a8a007 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Returning 404 to user: Instance eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:21:28.862677 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1732169b-a816-4ba6-9fac-91c6e5a8a007 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1" status: 404 len: 111 microversion: 2.1 time: 0.031862 Jul 07 07:21:28.862677 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 73/151] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:28 2022] GET /compute/v2.1/servers/eb98b1db-9890-4e5a-a284-ebc2f14b3fe1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:21:28.972756 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-574296039", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "networks": [{"uuid": "fa4f9607-ad0d-41c7-bf38-9c54623b6b3d"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:36.575856 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] validate_networks() for [('fa4f9607-ad0d-41c7-bf38-9c54623b6b3d', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:21:37.183394 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:21:37.183939 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:21:37.184293 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:21:37.184698 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:21:37.185115 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:21:37.200138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:37.202329 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:37.203970 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:37.204462 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:37.231859 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Getting quotas for project 559507d94a984b9f9663ed9f127668fb. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:21:37.235466 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Getting quotas for user 2e6e49df0e254b4284950e4bbe65ab45 and project 559507d94a984b9f9663ed9f127668fb. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:21:37.248427 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:21:37.250939 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:21:37.310291 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-200e1ebd-7905-4130-a688-91d5ed360740 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.342521 Jul 07 07:21:37.316227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 79/152] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:21:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 8349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 07 07:21:37.322011 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cdc84d45-ec8c-4628-bd1e-f40a89819b67 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:37.322719 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cdc84d45-ec8c-4628-bd1e-f40a89819b67 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:37.385684 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cdc84d45-ec8c-4628-bd1e-f40a89819b67 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:37.394959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cdc84d45-ec8c-4628-bd1e-f40a89819b67 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1213 microversion: 2.1 time: 0.075953 Jul 07 07:21:37.396132 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 80/153] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:37 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:37.456401 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1646324160", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:37.525544 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] validate_networks() for [('713aabcc-1616-4491-9707-c7efe5202fa0', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:21:38.018314 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:21:38.019048 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:21:38.019699 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:21:38.020138 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:21:38.020554 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:21:38.033867 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:38.034323 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:38.036078 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:38.037355 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:38.058136 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Getting quotas for project 441079c8bc1b4a4fb8f38fff6728f3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:21:38.066832 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Getting quotas for user b80ab2a9c7504806851400e07074004e and project 441079c8bc1b4a4fb8f38fff6728f3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:21:38.104458 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:21:38.108971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:21:38.189664 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-664088dc-62b2-41f1-9443-650798cedf02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.924303 Jul 07 07:21:38.190932 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 74/154] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:21:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:21:38.200518 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6d5c9a98-2d4a-4a6d-bfb6-b1b350d9cdd2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:38.201924 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6d5c9a98-2d4a-4a6d-bfb6-b1b350d9cdd2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:38.288326 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6d5c9a98-2d4a-4a6d-bfb6-b1b350d9cdd2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:38.297050 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6d5c9a98-2d4a-4a6d-bfb6-b1b350d9cdd2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1222 microversion: 2.1 time: 0.099873 Jul 07 07:21:38.297780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 81/155] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:38 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:38.361458 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-727490730", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:38.415754 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7df4b24e-e852-4fde-a849-fff54b99f1ea tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:38.416407 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7df4b24e-e852-4fde-a849-fff54b99f1ea tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:38.423528 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7df4b24e-e852-4fde-a849-fff54b99f1ea tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:38.423747 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7df4b24e-e852-4fde-a849-fff54b99f1ea tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:38.424700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7df4b24e-e852-4fde-a849-fff54b99f1ea tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:38.425128 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7df4b24e-e852-4fde-a849-fff54b99f1ea tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:38.446747 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] validate_networks() for [('713aabcc-1616-4491-9707-c7efe5202fa0', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:21:38.526753 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7df4b24e-e852-4fde-a849-fff54b99f1ea tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:38.544455 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7df4b24e-e852-4fde-a849-fff54b99f1ea tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1265 microversion: 2.1 time: 0.135024 Jul 07 07:21:38.545054 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 82/156] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:38 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:38.916689 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:21:38.917158 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:21:38.917662 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:21:38.918063 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:21:38.918504 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:21:38.927466 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:38.927913 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:38.928693 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:38.929177 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:38.947035 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Getting quotas for project 441079c8bc1b4a4fb8f38fff6728f3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:21:38.951286 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Getting quotas for user b80ab2a9c7504806851400e07074004e and project 441079c8bc1b4a4fb8f38fff6728f3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:21:38.963330 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:21:38.965688 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:21:39.041035 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9b9580f7-f224-4feb-ab5c-4cb2fd05cc9f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.679544 Jul 07 07:21:39.042265 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 75/157] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:21:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:21:39.052081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4cbdf4fe-8274-4a59-a947-e23882c84844 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:39.052686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4cbdf4fe-8274-4a59-a947-e23882c84844 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:39.120547 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4cbdf4fe-8274-4a59-a947-e23882c84844 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:39.128083 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4cbdf4fe-8274-4a59-a947-e23882c84844 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1221 microversion: 2.1 time: 0.079998 Jul 07 07:21:39.129264 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 83/158] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:39 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:39.569383 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-604c5cb9-fdbe-4ca3-a790-b50049894b46 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:39.570250 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-604c5cb9-fdbe-4ca3-a790-b50049894b46 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:39.582419 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-604c5cb9-fdbe-4ca3-a790-b50049894b46 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:39.583006 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-604c5cb9-fdbe-4ca3-a790-b50049894b46 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:39.584300 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-604c5cb9-fdbe-4ca3-a790-b50049894b46 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:39.584969 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-604c5cb9-fdbe-4ca3-a790-b50049894b46 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:40.012351 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-604c5cb9-fdbe-4ca3-a790-b50049894b46 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:40.028571 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-604c5cb9-fdbe-4ca3-a790-b50049894b46 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.462549 Jul 07 07:21:40.029562 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 76/159] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:39 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:40.147627 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-79a38f83-b958-44e1-ac6c-6fa6a7c25409 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:40.148946 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-79a38f83-b958-44e1-ac6c-6fa6a7c25409 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:40.168244 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-79a38f83-b958-44e1-ac6c-6fa6a7c25409 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:40.171509 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-79a38f83-b958-44e1-ac6c-6fa6a7c25409 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:40.172559 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-79a38f83-b958-44e1-ac6c-6fa6a7c25409 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:40.176049 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-79a38f83-b958-44e1-ac6c-6fa6a7c25409 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:40.682046 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-79a38f83-b958-44e1-ac6c-6fa6a7c25409 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:40.692075 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-79a38f83-b958-44e1-ac6c-6fa6a7c25409 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1273 microversion: 2.1 time: 0.551341 Jul 07 07:21:40.693505 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 84/160] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:40 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1273 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:41.046528 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7071f0bc-f968-46ec-9357-4957e9c6c782 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:41.048029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7071f0bc-f968-46ec-9357-4957e9c6c782 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:41.055396 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7071f0bc-f968-46ec-9357-4957e9c6c782 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:41.056823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7071f0bc-f968-46ec-9357-4957e9c6c782 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:41.057850 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7071f0bc-f968-46ec-9357-4957e9c6c782 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:41.058474 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7071f0bc-f968-46ec-9357-4957e9c6c782 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:41.162100 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-dc2ae0d0-5e4e-4ef4-973a-065af1df8468 req-f83370d1-7143-483e-87cd-0f9d63f5d71b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a", "tag": "0d0f94d6-fa04-4e73-ace4-6a72d61de426"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:41.178186 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-dc2ae0d0-5e4e-4ef4-973a-065af1df8468 req-f83370d1-7143-483e-87cd-0f9d63f5d71b service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:41.178785 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-dc2ae0d0-5e4e-4ef4-973a-065af1df8468 req-f83370d1-7143-483e-87cd-0f9d63f5d71b service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:41.198191 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-dc2ae0d0-5e4e-4ef4-973a-065af1df8468 req-f83370d1-7143-483e-87cd-0f9d63f5d71b service nova] Creating event network-changed:0d0f94d6-fa04-4e73-ace4-6a72d61de426 for instance aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a on hv-cinder-82660 Jul 07 07:21:41.206128 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-dc2ae0d0-5e4e-4ef4-973a-065af1df8468 req-f83370d1-7143-483e-87cd-0f9d63f5d71b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052725 Jul 07 07:21:41.207462 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 85/161] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:41.448360 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7071f0bc-f968-46ec-9357-4957e9c6c782 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:41.458754 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7071f0bc-f968-46ec-9357-4957e9c6c782 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.416191 Jul 07 07:21:41.462749 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 77/162] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:41 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:41.712293 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c61aabc1-a33b-46f0-9635-0043bbfe832b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:41.714789 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c61aabc1-a33b-46f0-9635-0043bbfe832b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:41.738378 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c61aabc1-a33b-46f0-9635-0043bbfe832b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:41.738957 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c61aabc1-a33b-46f0-9635-0043bbfe832b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:41.739866 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c61aabc1-a33b-46f0-9635-0043bbfe832b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:41.740591 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c61aabc1-a33b-46f0-9635-0043bbfe832b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:41.836271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c61aabc1-a33b-46f0-9635-0043bbfe832b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:41.865652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c61aabc1-a33b-46f0-9635-0043bbfe832b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1279 microversion: 2.1 time: 0.145046 Jul 07 07:21:41.868562 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 86/163] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:41 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:42.475694 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-114efa6d-adb6-464d-8708-498d96195afe req-713bdefd-933d-4c35-84aa-e054f8192862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3f038b4-3e52-4a94-833f-708642a6fe10", "tag": "892c6761-f95f-4d15-8cdf-6f04bacad94e"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:42.478096 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-28194d73-70a1-455d-a36c-113da3954fbb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:42.478788 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-28194d73-70a1-455d-a36c-113da3954fbb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:42.489973 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28194d73-70a1-455d-a36c-113da3954fbb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:42.493430 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28194d73-70a1-455d-a36c-113da3954fbb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:42.495113 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-114efa6d-adb6-464d-8708-498d96195afe req-713bdefd-933d-4c35-84aa-e054f8192862 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:42.498206 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28194d73-70a1-455d-a36c-113da3954fbb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:42.500775 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-114efa6d-adb6-464d-8708-498d96195afe req-713bdefd-933d-4c35-84aa-e054f8192862 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:42.501487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28194d73-70a1-455d-a36c-113da3954fbb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:42.515706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-114efa6d-adb6-464d-8708-498d96195afe req-713bdefd-933d-4c35-84aa-e054f8192862 service nova] Creating event network-changed:892c6761-f95f-4d15-8cdf-6f04bacad94e for instance f3f038b4-3e52-4a94-833f-708642a6fe10 on hv-cinder-82660 Jul 07 07:21:42.530612 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-114efa6d-adb6-464d-8708-498d96195afe req-713bdefd-933d-4c35-84aa-e054f8192862 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058280 Jul 07 07:21:42.531985 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 78/164] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:42.732079 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28194d73-70a1-455d-a36c-113da3954fbb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:42.740653 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-28194d73-70a1-455d-a36c-113da3954fbb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.266486 Jul 07 07:21:42.751006 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 87/165] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:42 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:42.883918 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cc90a481-d225-4fcf-9023-9a2a46c60228 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:42.885092 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cc90a481-d225-4fcf-9023-9a2a46c60228 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:42.892490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc90a481-d225-4fcf-9023-9a2a46c60228 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:42.892862 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc90a481-d225-4fcf-9023-9a2a46c60228 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:42.893702 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc90a481-d225-4fcf-9023-9a2a46c60228 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:42.894129 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc90a481-d225-4fcf-9023-9a2a46c60228 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:43.049470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cc90a481-d225-4fcf-9023-9a2a46c60228 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:43.057452 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cc90a481-d225-4fcf-9023-9a2a46c60228 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.177912 Jul 07 07:21:43.058148 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 79/166] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:42 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:43.761456 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-63491342-3f76-4823-85b4-9de124d872b6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:43.762073 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-63491342-3f76-4823-85b4-9de124d872b6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:43.768980 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63491342-3f76-4823-85b4-9de124d872b6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:43.769464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63491342-3f76-4823-85b4-9de124d872b6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:43.770226 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63491342-3f76-4823-85b4-9de124d872b6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:43.770657 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63491342-3f76-4823-85b4-9de124d872b6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:43.906145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63491342-3f76-4823-85b4-9de124d872b6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:43.915027 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-63491342-3f76-4823-85b4-9de124d872b6 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.159235 Jul 07 07:21:43.915694 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 88/167] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:43 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:44.075377 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-06acd9b5-1c20-41c2-9243-6f2b4c2e5fe2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:44.075970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-06acd9b5-1c20-41c2-9243-6f2b4c2e5fe2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:44.083270 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06acd9b5-1c20-41c2-9243-6f2b4c2e5fe2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:44.083769 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06acd9b5-1c20-41c2-9243-6f2b4c2e5fe2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:44.084583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06acd9b5-1c20-41c2-9243-6f2b4c2e5fe2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:44.085045 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-06acd9b5-1c20-41c2-9243-6f2b4c2e5fe2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:44.219471 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-06acd9b5-1c20-41c2-9243-6f2b4c2e5fe2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:44.227528 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-06acd9b5-1c20-41c2-9243-6f2b4c2e5fe2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.156398 Jul 07 07:21:44.228102 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 80/168] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:44 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:44.932840 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c5c5943a-5fe9-4778-8572-2f3787c1c6c2 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:44.933412 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c5c5943a-5fe9-4778-8572-2f3787c1c6c2 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:44.940812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5c5943a-5fe9-4778-8572-2f3787c1c6c2 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:44.941386 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5c5943a-5fe9-4778-8572-2f3787c1c6c2 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:44.942245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5c5943a-5fe9-4778-8572-2f3787c1c6c2 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:44.942715 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5c5943a-5fe9-4778-8572-2f3787c1c6c2 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:45.084883 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c5c5943a-5fe9-4778-8572-2f3787c1c6c2 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:45.093164 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c5c5943a-5fe9-4778-8572-2f3787c1c6c2 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.164436 Jul 07 07:21:45.093784 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 89/169] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:44 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:45.244915 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-68754165-9a67-44d6-8e50-4609fcd192c8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:45.245671 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-68754165-9a67-44d6-8e50-4609fcd192c8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:45.256461 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68754165-9a67-44d6-8e50-4609fcd192c8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:45.256461 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68754165-9a67-44d6-8e50-4609fcd192c8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:45.256461 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68754165-9a67-44d6-8e50-4609fcd192c8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:45.256461 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68754165-9a67-44d6-8e50-4609fcd192c8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:45.402627 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-68754165-9a67-44d6-8e50-4609fcd192c8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:45.413906 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-68754165-9a67-44d6-8e50-4609fcd192c8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.173064 Jul 07 07:21:45.414551 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 81/170] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:45 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:45.626738 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-36b20f90-7626-4ead-b72c-c3f345d81dbc req-a3289f0c-c0ce-4468-8735-86a9189cef0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d87467-2f1b-44d1-8284-ce40fe9f5c75", "tag": "ad225bf5-677c-4aa5-85e9-6bd523bd389f"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:45.635508 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-36b20f90-7626-4ead-b72c-c3f345d81dbc req-a3289f0c-c0ce-4468-8735-86a9189cef0f service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:45.637472 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-36b20f90-7626-4ead-b72c-c3f345d81dbc req-a3289f0c-c0ce-4468-8735-86a9189cef0f service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:45.654558 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-36b20f90-7626-4ead-b72c-c3f345d81dbc req-a3289f0c-c0ce-4468-8735-86a9189cef0f service nova] Creating event network-changed:ad225bf5-677c-4aa5-85e9-6bd523bd389f for instance a1d87467-2f1b-44d1-8284-ce40fe9f5c75 on hv-cinder-82660 Jul 07 07:21:45.659424 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-36b20f90-7626-4ead-b72c-c3f345d81dbc req-a3289f0c-c0ce-4468-8735-86a9189cef0f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036692 Jul 07 07:21:45.660041 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 90/171] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:46.110674 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dac8e0b7-07b4-4bb2-b055-d23b05355c30 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:46.111351 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dac8e0b7-07b4-4bb2-b055-d23b05355c30 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:46.118054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dac8e0b7-07b4-4bb2-b055-d23b05355c30 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:46.118515 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dac8e0b7-07b4-4bb2-b055-d23b05355c30 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:46.119267 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dac8e0b7-07b4-4bb2-b055-d23b05355c30 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:46.119720 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dac8e0b7-07b4-4bb2-b055-d23b05355c30 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:46.315557 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dac8e0b7-07b4-4bb2-b055-d23b05355c30 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:46.325072 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dac8e0b7-07b4-4bb2-b055-d23b05355c30 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.218613 Jul 07 07:21:46.325717 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 82/172] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:46 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:46.432360 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-857a2c3f-af01-4d8e-a3f2-b62a9e1c0b45 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:46.433235 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-857a2c3f-af01-4d8e-a3f2-b62a9e1c0b45 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:46.441364 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-857a2c3f-af01-4d8e-a3f2-b62a9e1c0b45 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:46.442006 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-857a2c3f-af01-4d8e-a3f2-b62a9e1c0b45 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:46.442881 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-857a2c3f-af01-4d8e-a3f2-b62a9e1c0b45 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:46.443407 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-857a2c3f-af01-4d8e-a3f2-b62a9e1c0b45 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:46.735934 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-857a2c3f-af01-4d8e-a3f2-b62a9e1c0b45 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:46.747433 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-857a2c3f-af01-4d8e-a3f2-b62a9e1c0b45 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.319611 Jul 07 07:21:46.756812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 91/173] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:46 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:47.342657 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dec68b79-e3c7-417a-8701-f29c035f1481 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:47.344209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dec68b79-e3c7-417a-8701-f29c035f1481 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:47.352997 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dec68b79-e3c7-417a-8701-f29c035f1481 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:47.354044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dec68b79-e3c7-417a-8701-f29c035f1481 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:47.358003 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dec68b79-e3c7-417a-8701-f29c035f1481 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:47.359018 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dec68b79-e3c7-417a-8701-f29c035f1481 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:47.508576 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dec68b79-e3c7-417a-8701-f29c035f1481 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:47.516630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dec68b79-e3c7-417a-8701-f29c035f1481 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.178020 Jul 07 07:21:47.517242 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 83/174] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:47 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:47.765122 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ab342240-70c4-4542-98d5-3849429e4a53 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:47.765717 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ab342240-70c4-4542-98d5-3849429e4a53 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:47.767762 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:47.775259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab342240-70c4-4542-98d5-3849429e4a53 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:47.775705 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab342240-70c4-4542-98d5-3849429e4a53 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:47.776517 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab342240-70c4-4542-98d5-3849429e4a53 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:47.776959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab342240-70c4-4542-98d5-3849429e4a53 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:47.783165 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:47.925785 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ab342240-70c4-4542-98d5-3849429e4a53 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:47.934314 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ab342240-70c4-4542-98d5-3849429e4a53 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.173341 Jul 07 07:21:47.934873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 92/175] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:47 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:48.533830 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8a2a43be-fb84-4eff-ac95-ab3d4d73e4fe tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:48.534412 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8a2a43be-fb84-4eff-ac95-ab3d4d73e4fe tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:48.537335 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:48.543404 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a2a43be-fb84-4eff-ac95-ab3d4d73e4fe tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:48.543862 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a2a43be-fb84-4eff-ac95-ab3d4d73e4fe tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:48.544671 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a2a43be-fb84-4eff-ac95-ab3d4d73e4fe tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:48.545104 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8a2a43be-fb84-4eff-ac95-ab3d4d73e4fe tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:48.551181 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:48.690487 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8a2a43be-fb84-4eff-ac95-ab3d4d73e4fe tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:48.698607 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8a2a43be-fb84-4eff-ac95-ab3d4d73e4fe tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.168630 Jul 07 07:21:48.699183 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 84/176] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:48 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:48.952764 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fee69f7a-4853-4b7d-b248-799376569a43 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:48.953533 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fee69f7a-4853-4b7d-b248-799376569a43 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:48.960401 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fee69f7a-4853-4b7d-b248-799376569a43 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:48.960824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fee69f7a-4853-4b7d-b248-799376569a43 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:48.961755 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fee69f7a-4853-4b7d-b248-799376569a43 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:48.962194 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fee69f7a-4853-4b7d-b248-799376569a43 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:49.103940 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fee69f7a-4853-4b7d-b248-799376569a43 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:49.111998 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fee69f7a-4853-4b7d-b248-799376569a43 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.163660 Jul 07 07:21:49.112570 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 93/177] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:48 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:49.718495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-05fe84cb-2468-44c8-83cc-ddad16b139bf tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:49.719072 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-05fe84cb-2468-44c8-83cc-ddad16b139bf tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:49.721565 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:49.722229 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=12 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:49.730415 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05fe84cb-2468-44c8-83cc-ddad16b139bf tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:49.730989 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05fe84cb-2468-44c8-83cc-ddad16b139bf tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:49.732138 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05fe84cb-2468-44c8-83cc-ddad16b139bf tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:49.732557 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05fe84cb-2468-44c8-83cc-ddad16b139bf tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:49.877252 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05fe84cb-2468-44c8-83cc-ddad16b139bf tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:49.885254 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-05fe84cb-2468-44c8-83cc-ddad16b139bf tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.172529 Jul 07 07:21:49.885881 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 85/178] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:49 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:50.129547 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-88eaa7d2-3b06-4183-b2a5-3f0c18e77150 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:50.130071 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-88eaa7d2-3b06-4183-b2a5-3f0c18e77150 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:50.131968 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=12 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:50.137966 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88eaa7d2-3b06-4183-b2a5-3f0c18e77150 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:50.138452 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88eaa7d2-3b06-4183-b2a5-3f0c18e77150 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:50.139299 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88eaa7d2-3b06-4183-b2a5-3f0c18e77150 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:50.139772 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-88eaa7d2-3b06-4183-b2a5-3f0c18e77150 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:50.279406 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-88eaa7d2-3b06-4183-b2a5-3f0c18e77150 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:50.287775 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-88eaa7d2-3b06-4183-b2a5-3f0c18e77150 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.162209 Jul 07 07:21:50.288368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 94/179] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:50 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:50.903760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-10a3011c-80a3-486f-bfca-f373eea44973 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:50.904498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-10a3011c-80a3-486f-bfca-f373eea44973 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:50.911337 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10a3011c-80a3-486f-bfca-f373eea44973 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:50.911779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10a3011c-80a3-486f-bfca-f373eea44973 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:50.912540 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10a3011c-80a3-486f-bfca-f373eea44973 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:50.912962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10a3011c-80a3-486f-bfca-f373eea44973 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:51.052556 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-10a3011c-80a3-486f-bfca-f373eea44973 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:51.060756 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-10a3011c-80a3-486f-bfca-f373eea44973 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.161021 Jul 07 07:21:51.061367 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 86/180] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:50 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:51.305337 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-65d438b4-bfee-4ccb-a87e-acab75541349 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:51.305927 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-65d438b4-bfee-4ccb-a87e-acab75541349 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:51.312672 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65d438b4-bfee-4ccb-a87e-acab75541349 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:51.313121 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65d438b4-bfee-4ccb-a87e-acab75541349 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:51.313912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65d438b4-bfee-4ccb-a87e-acab75541349 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:51.314341 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65d438b4-bfee-4ccb-a87e-acab75541349 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:51.459736 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-65d438b4-bfee-4ccb-a87e-acab75541349 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:51.468954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-65d438b4-bfee-4ccb-a87e-acab75541349 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.167701 Jul 07 07:21:51.469748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 95/181] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:51 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:52.078681 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f7892cfa-3e4c-49b4-b034-f5f780871ced tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:52.079294 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f7892cfa-3e4c-49b4-b034-f5f780871ced tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:52.086392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f7892cfa-3e4c-49b4-b034-f5f780871ced tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:52.086847 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f7892cfa-3e4c-49b4-b034-f5f780871ced tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:52.087622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f7892cfa-3e4c-49b4-b034-f5f780871ced tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:52.088054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f7892cfa-3e4c-49b4-b034-f5f780871ced tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:52.235427 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f7892cfa-3e4c-49b4-b034-f5f780871ced tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:52.243636 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f7892cfa-3e4c-49b4-b034-f5f780871ced tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.168906 Jul 07 07:21:52.244223 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 87/182] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:52 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:52.497848 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f58dbf4c-9a22-48a0-86de-0f96a04bd69c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:52.498451 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f58dbf4c-9a22-48a0-86de-0f96a04bd69c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:52.500770 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:21:52.506270 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f58dbf4c-9a22-48a0-86de-0f96a04bd69c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:52.506755 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f58dbf4c-9a22-48a0-86de-0f96a04bd69c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:52.507534 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f58dbf4c-9a22-48a0-86de-0f96a04bd69c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:52.507967 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f58dbf4c-9a22-48a0-86de-0f96a04bd69c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:52.643701 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f58dbf4c-9a22-48a0-86de-0f96a04bd69c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:52.652600 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f58dbf4c-9a22-48a0-86de-0f96a04bd69c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.160224 Jul 07 07:21:52.653581 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 96/183] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:52 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:52.779202 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-29a376a0-b687-4475-ad8b-122b48affb93 req-37a7f6ad-8296-49cf-97fe-91553c1ffc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a", "name": "network-vif-plugged", "status": "completed", "tag": "0d0f94d6-fa04-4e73-ace4-6a72d61de426"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:52.787602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-29a376a0-b687-4475-ad8b-122b48affb93 req-37a7f6ad-8296-49cf-97fe-91553c1ffc44 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:52.788047 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-29a376a0-b687-4475-ad8b-122b48affb93 req-37a7f6ad-8296-49cf-97fe-91553c1ffc44 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:52.800082 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-29a376a0-b687-4475-ad8b-122b48affb93 req-37a7f6ad-8296-49cf-97fe-91553c1ffc44 service nova] Creating event network-vif-plugged:0d0f94d6-fa04-4e73-ace4-6a72d61de426 for instance aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a on hv-cinder-82660 Jul 07 07:21:52.805046 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-29a376a0-b687-4475-ad8b-122b48affb93 req-37a7f6ad-8296-49cf-97fe-91553c1ffc44 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030079 Jul 07 07:21:52.805755 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 88/184] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:53.263912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aceedbeb-e6ac-4504-a68b-8575d41dd8ff tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:53.264541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aceedbeb-e6ac-4504-a68b-8575d41dd8ff tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:53.271056 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aceedbeb-e6ac-4504-a68b-8575d41dd8ff tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:53.271505 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aceedbeb-e6ac-4504-a68b-8575d41dd8ff tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:53.272271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aceedbeb-e6ac-4504-a68b-8575d41dd8ff tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:53.272700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aceedbeb-e6ac-4504-a68b-8575d41dd8ff tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:53.420050 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aceedbeb-e6ac-4504-a68b-8575d41dd8ff tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:53.428257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aceedbeb-e6ac-4504-a68b-8575d41dd8ff tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.168216 Jul 07 07:21:53.428862 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 97/185] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:53 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:53.672338 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-54559e20-83c8-43ae-b543-b125c39efd86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:53.672949 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-54559e20-83c8-43ae-b543-b125c39efd86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:53.679939 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54559e20-83c8-43ae-b543-b125c39efd86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:53.680399 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54559e20-83c8-43ae-b543-b125c39efd86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:53.681174 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54559e20-83c8-43ae-b543-b125c39efd86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:53.681645 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54559e20-83c8-43ae-b543-b125c39efd86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:53.844812 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-54559e20-83c8-43ae-b543-b125c39efd86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:53.853747 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-54559e20-83c8-43ae-b543-b125c39efd86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.186548 Jul 07 07:21:53.854450 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 89/186] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:53 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:54.451691 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-921ec679-60fb-4583-8356-a032d9762dfb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:54.452306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-921ec679-60fb-4583-8356-a032d9762dfb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:54.460984 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-921ec679-60fb-4583-8356-a032d9762dfb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:54.461540 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-921ec679-60fb-4583-8356-a032d9762dfb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:54.462441 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-921ec679-60fb-4583-8356-a032d9762dfb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:54.462900 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-921ec679-60fb-4583-8356-a032d9762dfb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:54.610681 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-921ec679-60fb-4583-8356-a032d9762dfb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:54.619363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-921ec679-60fb-4583-8356-a032d9762dfb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1313 microversion: 2.1 time: 0.173372 Jul 07 07:21:54.619946 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 98/187] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:54 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:54.871807 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-69c96292-3b7c-4ff6-b4cc-7f8fa21f8443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:54.872876 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-69c96292-3b7c-4ff6-b4cc-7f8fa21f8443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:54.880645 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-69c96292-3b7c-4ff6-b4cc-7f8fa21f8443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:54.881181 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-69c96292-3b7c-4ff6-b4cc-7f8fa21f8443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:54.882061 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-69c96292-3b7c-4ff6-b4cc-7f8fa21f8443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:54.882589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-69c96292-3b7c-4ff6-b4cc-7f8fa21f8443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:55.070138 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-69c96292-3b7c-4ff6-b4cc-7f8fa21f8443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:55.079670 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-69c96292-3b7c-4ff6-b4cc-7f8fa21f8443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.211950 Jul 07 07:21:55.080491 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 90/188] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:54 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:55.638477 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a142c218-a855-4de8-aeed-349fe0c255ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:55.642457 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a142c218-a855-4de8-aeed-349fe0c255ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:55.651033 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a142c218-a855-4de8-aeed-349fe0c255ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:55.651477 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a142c218-a855-4de8-aeed-349fe0c255ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:55.652242 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a142c218-a855-4de8-aeed-349fe0c255ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:55.653049 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a142c218-a855-4de8-aeed-349fe0c255ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:55.812778 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a142c218-a855-4de8-aeed-349fe0c255ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:55.820890 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a142c218-a855-4de8-aeed-349fe0c255ab tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1497 microversion: 2.1 time: 0.186898 Jul 07 07:21:55.821877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 99/189] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:55 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:56.099861 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-261051be-c60a-42f0-baed-657e17a5dfba tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:56.101537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-261051be-c60a-42f0-baed-657e17a5dfba tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:56.112665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-261051be-c60a-42f0-baed-657e17a5dfba tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:56.113454 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-261051be-c60a-42f0-baed-657e17a5dfba tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:56.114511 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-261051be-c60a-42f0-baed-657e17a5dfba tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:56.115103 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-261051be-c60a-42f0-baed-657e17a5dfba tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:56.336441 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-261051be-c60a-42f0-baed-657e17a5dfba tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:56.346876 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-261051be-c60a-42f0-baed-657e17a5dfba tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.252673 Jul 07 07:21:56.348206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 91/190] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:56 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:56.643998 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fb5cc614-b116-43cb-b082-961e4f5bf493 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:56.643998 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fb5cc614-b116-43cb-b082-961e4f5bf493 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:56.647478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb5cc614-b116-43cb-b082-961e4f5bf493 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:56.647925 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb5cc614-b116-43cb-b082-961e4f5bf493 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:56.648708 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb5cc614-b116-43cb-b082-961e4f5bf493 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:56.649142 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb5cc614-b116-43cb-b082-961e4f5bf493 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:56.677265 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fb5cc614-b116-43cb-b082-961e4f5bf493 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:21:56.778381 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fb5cc614-b116-43cb-b082-961e4f5bf493 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "DELETE /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 204 len: 0 microversion: 2.1 time: 0.142228 Jul 07 07:21:56.783781 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 100/191] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:21:56 2022] DELETE /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:21:56.790511 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-acda404f-a47c-4650-b333-a62a87189ec5 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:56.791816 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-acda404f-a47c-4650-b333-a62a87189ec5 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:56.798600 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-acda404f-a47c-4650-b333-a62a87189ec5 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:56.799337 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-acda404f-a47c-4650-b333-a62a87189ec5 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:56.800334 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-acda404f-a47c-4650-b333-a62a87189ec5 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:56.800975 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-acda404f-a47c-4650-b333-a62a87189ec5 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:56.989990 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-acda404f-a47c-4650-b333-a62a87189ec5 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:57.000592 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-acda404f-a47c-4650-b333-a62a87189ec5 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1503 microversion: 2.1 time: 0.214090 Jul 07 07:21:57.001354 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 92/192] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:56 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:57.365671 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d261a26e-3515-45e5-891c-affa460af13a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:57.367207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d261a26e-3515-45e5-891c-affa460af13a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:57.374635 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d261a26e-3515-45e5-891c-affa460af13a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:57.375076 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d261a26e-3515-45e5-891c-affa460af13a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:57.376071 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d261a26e-3515-45e5-891c-affa460af13a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:57.376997 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d261a26e-3515-45e5-891c-affa460af13a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:57.551389 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d261a26e-3515-45e5-891c-affa460af13a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:57.561037 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d261a26e-3515-45e5-891c-affa460af13a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.199451 Jul 07 07:21:57.561946 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 101/193] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:57 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:57.804310 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-3954d4f3-8ff0-4b9d-8bbc-9fc44f00a7a9 req-93e0ae90-ff47-46dd-946e-c4ce42b0a4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f038b4-3e52-4a94-833f-708642a6fe10", "name": "network-vif-plugged", "status": "completed", "tag": "892c6761-f95f-4d15-8cdf-6f04bacad94e"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:57.817331 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-3954d4f3-8ff0-4b9d-8bbc-9fc44f00a7a9 req-93e0ae90-ff47-46dd-946e-c4ce42b0a4d6 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:57.818286 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-3954d4f3-8ff0-4b9d-8bbc-9fc44f00a7a9 req-93e0ae90-ff47-46dd-946e-c4ce42b0a4d6 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:57.834596 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-3954d4f3-8ff0-4b9d-8bbc-9fc44f00a7a9 req-93e0ae90-ff47-46dd-946e-c4ce42b0a4d6 service nova] Creating event network-vif-plugged:892c6761-f95f-4d15-8cdf-6f04bacad94e for instance f3f038b4-3e52-4a94-833f-708642a6fe10 on hv-cinder-82660 Jul 07 07:21:57.842573 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-3954d4f3-8ff0-4b9d-8bbc-9fc44f00a7a9 req-93e0ae90-ff47-46dd-946e-c4ce42b0a4d6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047792 Jul 07 07:21:57.844556 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 93/194] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:58.022419 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dd959b49-d38b-4c69-8a02-3b07cd3a7109 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:58.023928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd959b49-d38b-4c69-8a02-3b07cd3a7109 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:58.038507 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd959b49-d38b-4c69-8a02-3b07cd3a7109 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:58.040450 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd959b49-d38b-4c69-8a02-3b07cd3a7109 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:58.041857 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd959b49-d38b-4c69-8a02-3b07cd3a7109 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:58.042488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd959b49-d38b-4c69-8a02-3b07cd3a7109 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:58.226904 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd959b49-d38b-4c69-8a02-3b07cd3a7109 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:58.238901 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dd959b49-d38b-4c69-8a02-3b07cd3a7109 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1503 microversion: 2.1 time: 0.223896 Jul 07 07:21:58.240796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 102/195] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:58 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:21:58.580756 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e1a984a2-4d98-4738-b16f-2cedc339e095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:58.581698 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e1a984a2-4d98-4738-b16f-2cedc339e095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:58.589099 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1a984a2-4d98-4738-b16f-2cedc339e095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:58.589858 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1a984a2-4d98-4738-b16f-2cedc339e095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:58.590724 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1a984a2-4d98-4738-b16f-2cedc339e095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:58.591257 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e1a984a2-4d98-4738-b16f-2cedc339e095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:58.735567 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e1a984a2-4d98-4738-b16f-2cedc339e095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:58.742993 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e1a984a2-4d98-4738-b16f-2cedc339e095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.167469 Jul 07 07:21:58.745559 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 94/196] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:58 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:59.256758 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9cef1d56-2003-4e0b-85ec-3895e5845255 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:59.257268 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9cef1d56-2003-4e0b-85ec-3895e5845255 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:59.263761 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9cef1d56-2003-4e0b-85ec-3895e5845255 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:59.264208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9cef1d56-2003-4e0b-85ec-3895e5845255 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:59.264981 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9cef1d56-2003-4e0b-85ec-3895e5845255 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:59.265424 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9cef1d56-2003-4e0b-85ec-3895e5845255 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:59.413035 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9cef1d56-2003-4e0b-85ec-3895e5845255 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:59.420776 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9cef1d56-2003-4e0b-85ec-3895e5845255 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1503 microversion: 2.1 time: 0.168528 Jul 07 07:21:59.421399 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 103/197] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:59 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:21:59.760595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3e433667-61a5-4489-b45e-bde371c1d175 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:21:59.762583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3e433667-61a5-4489-b45e-bde371c1d175 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:21:59.775037 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e433667-61a5-4489-b45e-bde371c1d175 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:59.775864 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e433667-61a5-4489-b45e-bde371c1d175 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:59.777316 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e433667-61a5-4489-b45e-bde371c1d175 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:59.778100 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3e433667-61a5-4489-b45e-bde371c1d175 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:59.880148 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-4ef41070-1671-4509-9235-14e5ee17f58e req-484dd39f-c049-4205-a1e8-56aaff13668c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d87467-2f1b-44d1-8284-ce40fe9f5c75", "name": "network-vif-plugged", "status": "completed", "tag": "ad225bf5-677c-4aa5-85e9-6bd523bd389f"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:21:59.891217 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-4ef41070-1671-4509-9235-14e5ee17f58e req-484dd39f-c049-4205-a1e8-56aaff13668c service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:21:59.891676 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-4ef41070-1671-4509-9235-14e5ee17f58e req-484dd39f-c049-4205-a1e8-56aaff13668c service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:21:59.909368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-4ef41070-1671-4509-9235-14e5ee17f58e req-484dd39f-c049-4205-a1e8-56aaff13668c service nova] Creating event network-vif-plugged:ad225bf5-677c-4aa5-85e9-6bd523bd389f for instance a1d87467-2f1b-44d1-8284-ce40fe9f5c75 on hv-cinder-82660 Jul 07 07:21:59.914501 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-4ef41070-1671-4509-9235-14e5ee17f58e req-484dd39f-c049-4205-a1e8-56aaff13668c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039448 Jul 07 07:21:59.915580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 104/198] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:21:59.963926 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3e433667-61a5-4489-b45e-bde371c1d175 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:21:59.972320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3e433667-61a5-4489-b45e-bde371c1d175 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.216027 Jul 07 07:21:59.972910 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 95/199] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:21:59 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:00.439250 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f71c763-9cd2-4d6b-b344-99c55d97068f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:00.439952 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f71c763-9cd2-4d6b-b344-99c55d97068f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:00.446945 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f71c763-9cd2-4d6b-b344-99c55d97068f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:00.447420 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f71c763-9cd2-4d6b-b344-99c55d97068f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:00.448172 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f71c763-9cd2-4d6b-b344-99c55d97068f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:00.448625 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f71c763-9cd2-4d6b-b344-99c55d97068f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:00.586682 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f71c763-9cd2-4d6b-b344-99c55d97068f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:00.594943 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f71c763-9cd2-4d6b-b344-99c55d97068f tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1503 microversion: 2.1 time: 0.160697 Jul 07 07:22:00.595492 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 105/200] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:00 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:00.990490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-250c4b87-814d-4880-8f50-3bf97b875006 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:00.991310 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-250c4b87-814d-4880-8f50-3bf97b875006 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:00.999799 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-250c4b87-814d-4880-8f50-3bf97b875006 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:01.000348 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-250c4b87-814d-4880-8f50-3bf97b875006 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:01.001203 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-250c4b87-814d-4880-8f50-3bf97b875006 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:01.001748 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-250c4b87-814d-4880-8f50-3bf97b875006 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:01.468570 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-250c4b87-814d-4880-8f50-3bf97b875006 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:01.471377 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-250c4b87-814d-4880-8f50-3bf97b875006 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.485159 Jul 07 07:22:01.473663 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 96/201] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:00 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:01.613636 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-880d5791-80cf-47ee-937a-2c766a5c2b2c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:01.614357 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-880d5791-80cf-47ee-937a-2c766a5c2b2c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:01.621270 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-880d5791-80cf-47ee-937a-2c766a5c2b2c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:01.622031 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-880d5791-80cf-47ee-937a-2c766a5c2b2c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:01.622997 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-880d5791-80cf-47ee-937a-2c766a5c2b2c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:01.623638 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-880d5791-80cf-47ee-937a-2c766a5c2b2c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:01.641686 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-ecb8d565-4e04-4cdd-b993-bba1ef948177 req-266ba29a-2424-4dc4-a63a-342d25b02aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a", "name": "network-vif-deleted", "tag": "0d0f94d6-fa04-4e73-ace4-6a72d61de426"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:01.652277 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ecb8d565-4e04-4cdd-b993-bba1ef948177 req-266ba29a-2424-4dc4-a63a-342d25b02aaf service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:01.652712 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ecb8d565-4e04-4cdd-b993-bba1ef948177 req-266ba29a-2424-4dc4-a63a-342d25b02aaf service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:01.670774 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-ecb8d565-4e04-4cdd-b993-bba1ef948177 req-266ba29a-2424-4dc4-a63a-342d25b02aaf service nova] Creating event network-vif-deleted:0d0f94d6-fa04-4e73-ace4-6a72d61de426 for instance aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a on hv-cinder-82660 Jul 07 07:22:01.678732 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-ecb8d565-4e04-4cdd-b993-bba1ef948177 req-266ba29a-2424-4dc4-a63a-342d25b02aaf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042183 Jul 07 07:22:01.679439 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 97/202] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:22:01.697988 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-880d5791-80cf-47ee-937a-2c766a5c2b2c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:01.706320 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-880d5791-80cf-47ee-937a-2c766a5c2b2c tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1461 microversion: 2.1 time: 0.097019 Jul 07 07:22:01.706813 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 106/203] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:01 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1461 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:02.492715 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3d35966c-a2d6-47a1-87a8-fa5742004097 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:02.493572 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3d35966c-a2d6-47a1-87a8-fa5742004097 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:02.517185 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d35966c-a2d6-47a1-87a8-fa5742004097 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:02.518047 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d35966c-a2d6-47a1-87a8-fa5742004097 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:02.519064 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d35966c-a2d6-47a1-87a8-fa5742004097 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:02.519680 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3d35966c-a2d6-47a1-87a8-fa5742004097 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:02.727827 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ff16a27a-f6dd-4488-9f5a-fec56d37f348 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:02.728804 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ff16a27a-f6dd-4488-9f5a-fec56d37f348 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:02.740229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff16a27a-f6dd-4488-9f5a-fec56d37f348 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:02.741246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff16a27a-f6dd-4488-9f5a-fec56d37f348 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:02.742886 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff16a27a-f6dd-4488-9f5a-fec56d37f348 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:02.743633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff16a27a-f6dd-4488-9f5a-fec56d37f348 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:02.762297 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3d35966c-a2d6-47a1-87a8-fa5742004097 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:02.772550 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3d35966c-a2d6-47a1-87a8-fa5742004097 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1321 microversion: 2.1 time: 0.285263 Jul 07 07:22:02.773732 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 98/204] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:02 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:02.829948 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ff16a27a-f6dd-4488-9f5a-fec56d37f348 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:02.836868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:02.845555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ff16a27a-f6dd-4488-9f5a-fec56d37f348 tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1298 microversion: 2.1 time: 0.124737 Jul 07 07:22:02.846214 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 107/205] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:02 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:03.792900 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-40e4aabe-bf72-4cfc-87cd-d810dfe14f6e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:03.793766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-40e4aabe-bf72-4cfc-87cd-d810dfe14f6e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:03.803568 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40e4aabe-bf72-4cfc-87cd-d810dfe14f6e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:03.804097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40e4aabe-bf72-4cfc-87cd-d810dfe14f6e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:03.805124 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40e4aabe-bf72-4cfc-87cd-d810dfe14f6e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:03.805667 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-40e4aabe-bf72-4cfc-87cd-d810dfe14f6e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:03.865965 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:03.866875 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:03.884100 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:03.884638 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:03.885946 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:03.886709 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:03.925687 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:03.926597 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:03.927234 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lazy-loading 'fault' on Instance uuid aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:22:04.032450 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-40e4aabe-bf72-4cfc-87cd-d810dfe14f6e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:04.035114 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e6e49df0e254b4284950e4bbe65ab45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559507d94a984b9f9663ed9f127668fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:04.044273 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-40e4aabe-bf72-4cfc-87cd-d810dfe14f6e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1514 microversion: 2.1 time: 0.258470 Jul 07 07:22:04.044911 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 99/206] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:03 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:04.048547 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e3ed52fc-029c-40c9-97c4-aa3294422eeb tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 200 len: 1303 microversion: 2.1 time: 0.188694 Jul 07 07:22:04.049144 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 108/207] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:03 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:04.061822 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-619e89e2-7040-44f4-9f84-f6d23d403e95 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:04.063432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-619e89e2-7040-44f4-9f84-f6d23d403e95 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:04.071024 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-619e89e2-7040-44f4-9f84-f6d23d403e95 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:04.071544 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-619e89e2-7040-44f4-9f84-f6d23d403e95 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:04.072458 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-619e89e2-7040-44f4-9f84-f6d23d403e95 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:04.072893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-619e89e2-7040-44f4-9f84-f6d23d403e95 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:04.096975 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-619e89e2-7040-44f4-9f84-f6d23d403e95 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lazy-loading 'flavor' on Instance uuid a1d87467-2f1b-44d1-8284-ce40fe9f5c75 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:22:04.212551 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:04.224598 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-619e89e2-7040-44f4-9f84-f6d23d403e95 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75/action" status: 200 len: 32 microversion: 2.1 time: 0.167396 Jul 07 07:22:04.225212 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 100/208] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:22:04 2022] POST /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 07:22:04.234866 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ae0e6e73-9585-4303-a3c7-68cb06cf04a0 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:04.235729 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ae0e6e73-9585-4303-a3c7-68cb06cf04a0 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:04.243189 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae0e6e73-9585-4303-a3c7-68cb06cf04a0 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:04.243703 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae0e6e73-9585-4303-a3c7-68cb06cf04a0 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:04.244452 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae0e6e73-9585-4303-a3c7-68cb06cf04a0 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:04.244880 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ae0e6e73-9585-4303-a3c7-68cb06cf04a0 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:04.390228 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ae0e6e73-9585-4303-a3c7-68cb06cf04a0 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:04.398302 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ae0e6e73-9585-4303-a3c7-68cb06cf04a0 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.167756 Jul 07 07:22:04.398882 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 109/209] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:04 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:05.071397 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2ca09a68-05f8-4ed1-a788-88339550b32e tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:05.073465 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2ca09a68-05f8-4ed1-a788-88339550b32e tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] [instance: aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:05.087679 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ca09a68-05f8-4ed1-a788-88339550b32e tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:05.089471 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ca09a68-05f8-4ed1-a788-88339550b32e tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:05.090342 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ca09a68-05f8-4ed1-a788-88339550b32e tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:05.090782 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ca09a68-05f8-4ed1-a788-88339550b32e tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:05.107665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-2ca09a68-05f8-4ed1-a788-88339550b32e tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] HTTP exception thrown: Instance aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a could not be found. Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2ca09a68-05f8-4ed1-a788-88339550b32e tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Request method failure captured: Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a HTTP/1.1 Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixolbLwvFkiZmzwiigvQpXO9Ku99o4RqdEDXH3PzV7GXy3uT6nyKECWvWIwXHAynEoq3L0ZWFd0-2dhTuooW5bA5sNdd9gldYLdqnkpuZzXuci9aGDJ5tE0BGZDVzZn4rj2yIQhU35z9XGnEOYjdKttqSmkxdJ_3Pmv3a56g3ntIaR5g Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 559507d94a984b9f9663ed9f127668fb Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesActionsTest-542144810 Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:22:05.109384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/559507d94a984b9f9663ed9f127668fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/559507d94a984b9f9663ed9f127668fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_559507d94a984b9f9663ed9f127668fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/559507d94a984b9f9663ed9f127668fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesActionsTest-542144810 Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 559507d94a984b9f9663ed9f127668fb Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesActionsTest-542144810 Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesActionsTest-542144810-project Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 2e6e49df0e254b4284950e4bbe65ab45 Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesActionsTest-542144810-project Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a could not be found. Jul 07 07:22:05.110903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': 'aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a'} Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a could not be found. Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:22:05.111823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a could not be found. Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a could not be found. Jul 07 07:22:05.113759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:22:05.115353 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2ca09a68-05f8-4ed1-a788-88339550b32e tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] Returning 404 to user: Instance aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:22:05.115353 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2ca09a68-05f8-4ed1-a788-88339550b32e tempest-VolumesActionsTest-542144810 tempest-VolumesActionsTest-542144810-project] 10.222.0.62 "GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a" status: 404 len: 111 microversion: 2.1 time: 0.047476 Jul 07 07:22:05.115353 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 101/210] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:05 2022] GET /compute/v2.1/servers/aa0ce88f-5e2e-4990-8d41-6d1ecce55f3a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:22:05.417283 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d2215c3e-7966-4cd5-9fd8-b27e59d91431 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:05.418057 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d2215c3e-7966-4cd5-9fd8-b27e59d91431 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:05.425131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2215c3e-7966-4cd5-9fd8-b27e59d91431 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:05.425934 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2215c3e-7966-4cd5-9fd8-b27e59d91431 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:05.426744 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2215c3e-7966-4cd5-9fd8-b27e59d91431 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:05.427174 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2215c3e-7966-4cd5-9fd8-b27e59d91431 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:05.654532 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d2215c3e-7966-4cd5-9fd8-b27e59d91431 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:05.664293 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d2215c3e-7966-4cd5-9fd8-b27e59d91431 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.252401 Jul 07 07:22:05.664873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 110/211] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:05 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:06.681090 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8c235c62-64ba-45e5-90c3-8b822acab76c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:06.681968 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8c235c62-64ba-45e5-90c3-8b822acab76c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:06.688994 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c235c62-64ba-45e5-90c3-8b822acab76c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:06.689489 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c235c62-64ba-45e5-90c3-8b822acab76c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:06.690266 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c235c62-64ba-45e5-90c3-8b822acab76c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:06.690698 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c235c62-64ba-45e5-90c3-8b822acab76c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:06.891686 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8c235c62-64ba-45e5-90c3-8b822acab76c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:06.901250 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8c235c62-64ba-45e5-90c3-8b822acab76c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.223943 Jul 07 07:22:06.902081 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 102/212] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:06 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:07.920542 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a372a48f-d6c0-4d8f-a9a8-c507e6c79acc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:07.921513 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a372a48f-d6c0-4d8f-a9a8-c507e6c79acc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:07.929027 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a372a48f-d6c0-4d8f-a9a8-c507e6c79acc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:07.929773 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a372a48f-d6c0-4d8f-a9a8-c507e6c79acc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:07.930735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a372a48f-d6c0-4d8f-a9a8-c507e6c79acc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:07.931436 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a372a48f-d6c0-4d8f-a9a8-c507e6c79acc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:08.174420 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a372a48f-d6c0-4d8f-a9a8-c507e6c79acc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:08.188363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a372a48f-d6c0-4d8f-a9a8-c507e6c79acc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.272686 Jul 07 07:22:08.189538 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 111/213] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:07 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:09.024916 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d931e3d9-23d6-440b-857a-fe1146745a38 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:09.026972 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d931e3d9-23d6-440b-857a-fe1146745a38 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:09.040194 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d931e3d9-23d6-440b-857a-fe1146745a38 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:09.041111 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d931e3d9-23d6-440b-857a-fe1146745a38 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:09.043686 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d931e3d9-23d6-440b-857a-fe1146745a38 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:09.044590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d931e3d9-23d6-440b-857a-fe1146745a38 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:09.091869 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d931e3d9-23d6-440b-857a-fe1146745a38 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/ips" status: 200 len: 146 microversion: 2.1 time: 0.073834 Jul 07 07:22:09.093411 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 103/214] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Jul 7 07:22:09 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/ips => generated 146 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:22:09.215969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6f0d76af-6135-4489-bdd2-9211ecb13411 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:09.217076 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6f0d76af-6135-4489-bdd2-9211ecb13411 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:09.223942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6f0d76af-6135-4489-bdd2-9211ecb13411 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:09.224713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6f0d76af-6135-4489-bdd2-9211ecb13411 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:09.225876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6f0d76af-6135-4489-bdd2-9211ecb13411 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:09.226496 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6f0d76af-6135-4489-bdd2-9211ecb13411 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:09.432921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6f0d76af-6135-4489-bdd2-9211ecb13411 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:09.448375 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6f0d76af-6135-4489-bdd2-9211ecb13411 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.237407 Jul 07 07:22:09.459288 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 112/215] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:09 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:10.467383 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3f9b9d1e-9461-4078-96ad-0863b1c12062 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:10.468848 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3f9b9d1e-9461-4078-96ad-0863b1c12062 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:10.483487 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f9b9d1e-9461-4078-96ad-0863b1c12062 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:10.483948 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f9b9d1e-9461-4078-96ad-0863b1c12062 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:10.484765 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f9b9d1e-9461-4078-96ad-0863b1c12062 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:10.485283 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f9b9d1e-9461-4078-96ad-0863b1c12062 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:10.906048 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f9b9d1e-9461-4078-96ad-0863b1c12062 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:10.940121 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3f9b9d1e-9461-4078-96ad-0863b1c12062 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.469515 Jul 07 07:22:10.942785 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 104/216] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:10 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:11.981704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-79a62756-4014-4c22-9e0b-66a2049155f4 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:11.988595 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-79a62756-4014-4c22-9e0b-66a2049155f4 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:12.041156 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-79a62756-4014-4c22-9e0b-66a2049155f4 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:12.043314 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-79a62756-4014-4c22-9e0b-66a2049155f4 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:12.052933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-79a62756-4014-4c22-9e0b-66a2049155f4 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:12.054431 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-79a62756-4014-4c22-9e0b-66a2049155f4 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:12.143113 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9daf6aa5-f13e-458e-b198-8d0e609e368f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39941333-712c-4116-a43b-b7b7a59b3026"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:12.148593 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9daf6aa5-f13e-458e-b198-8d0e609e368f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:12.188564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9daf6aa5-f13e-458e-b198-8d0e609e368f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:12.189036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9daf6aa5-f13e-458e-b198-8d0e609e368f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:12.189762 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9daf6aa5-f13e-458e-b198-8d0e609e368f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:12.190379 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9daf6aa5-f13e-458e-b198-8d0e609e368f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:12.478633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-79a62756-4014-4c22-9e0b-66a2049155f4 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:12.494187 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-79a62756-4014-4c22-9e0b-66a2049155f4 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.530083 Jul 07 07:22:12.497904 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 113/217] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:11 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:12.982652 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9daf6aa5-f13e-458e-b198-8d0e609e368f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.846327 Jul 07 07:22:12.986466 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 105/218] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:22:12 2022] POST /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:22:13.521738 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9d110046-4993-4d3e-9634-f7a4ee1db31c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:13.522413 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9d110046-4993-4d3e-9634-f7a4ee1db31c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:13.530935 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9d110046-4993-4d3e-9634-f7a4ee1db31c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:13.531413 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9d110046-4993-4d3e-9634-f7a4ee1db31c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:13.532504 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9d110046-4993-4d3e-9634-f7a4ee1db31c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:13.533122 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9d110046-4993-4d3e-9634-f7a4ee1db31c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:13.755431 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9d110046-4993-4d3e-9634-f7a4ee1db31c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:13.764600 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9d110046-4993-4d3e-9634-f7a4ee1db31c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.247886 Jul 07 07:22:13.765466 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 114/219] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:13 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:14.782360 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-928fbd1b-9eee-44b3-bfdb-4c8a6b6801d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:14.783194 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-928fbd1b-9eee-44b3-bfdb-4c8a6b6801d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:14.790764 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-928fbd1b-9eee-44b3-bfdb-4c8a6b6801d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:14.791354 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-928fbd1b-9eee-44b3-bfdb-4c8a6b6801d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:14.792222 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-928fbd1b-9eee-44b3-bfdb-4c8a6b6801d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:14.792849 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-928fbd1b-9eee-44b3-bfdb-4c8a6b6801d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:14.937707 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-928fbd1b-9eee-44b3-bfdb-4c8a6b6801d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:14.946541 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-928fbd1b-9eee-44b3-bfdb-4c8a6b6801d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.168546 Jul 07 07:22:14.947890 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 106/220] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:14 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:15.966431 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-85204532-6567-4382-90c2-0e168194eaac tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:15.967428 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-85204532-6567-4382-90c2-0e168194eaac tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:15.978888 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-85204532-6567-4382-90c2-0e168194eaac tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:15.979775 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-85204532-6567-4382-90c2-0e168194eaac tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:15.980832 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-85204532-6567-4382-90c2-0e168194eaac tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:15.981576 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-85204532-6567-4382-90c2-0e168194eaac tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:16.136136 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-85204532-6567-4382-90c2-0e168194eaac tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:16.145820 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-85204532-6567-4382-90c2-0e168194eaac tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.185372 Jul 07 07:22:16.146717 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 115/221] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:15 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:17.164849 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0ab9845b-ae3a-4181-a37a-a622a292a4c1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:17.165693 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0ab9845b-ae3a-4181-a37a-a622a292a4c1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:17.173023 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ab9845b-ae3a-4181-a37a-a622a292a4c1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:17.174019 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ab9845b-ae3a-4181-a37a-a622a292a4c1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:17.174907 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ab9845b-ae3a-4181-a37a-a622a292a4c1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:17.175366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ab9845b-ae3a-4181-a37a-a622a292a4c1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:17.327160 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0ab9845b-ae3a-4181-a37a-a622a292a4c1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:17.335689 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0ab9845b-ae3a-4181-a37a-a622a292a4c1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.175228 Jul 07 07:22:17.336317 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 107/222] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:17 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:18.045916 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f8c39333-e733-433a-bfed-2b4578d830a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:18.046510 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f8c39333-e733-433a-bfed-2b4578d830a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:18.054419 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8c39333-e733-433a-bfed-2b4578d830a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:18.055530 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8c39333-e733-433a-bfed-2b4578d830a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:18.057109 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8c39333-e733-433a-bfed-2b4578d830a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:18.057926 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f8c39333-e733-433a-bfed-2b4578d830a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:18.084423 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f8c39333-e733-433a-bfed-2b4578d830a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/ips" status: 200 len: 149 microversion: 2.1 time: 0.042929 Jul 07 07:22:18.085430 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 116/223] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Jul 7 07:22:18 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:22:18.357537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e5751070-4f00-4df5-8dd1-b500046e4255 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:18.358102 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e5751070-4f00-4df5-8dd1-b500046e4255 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:18.376630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5751070-4f00-4df5-8dd1-b500046e4255 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:18.377119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5751070-4f00-4df5-8dd1-b500046e4255 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:18.377909 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5751070-4f00-4df5-8dd1-b500046e4255 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:18.378598 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5751070-4f00-4df5-8dd1-b500046e4255 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:18.626711 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e5751070-4f00-4df5-8dd1-b500046e4255 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:18.639537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e5751070-4f00-4df5-8dd1-b500046e4255 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.287350 Jul 07 07:22:18.640593 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 108/224] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:18 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:18.688089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e89affbb-45b3-4d54-b589-51d5bef653e8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:18.688572 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e89affbb-45b3-4d54-b589-51d5bef653e8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:18.695356 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e89affbb-45b3-4d54-b589-51d5bef653e8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:18.695800 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e89affbb-45b3-4d54-b589-51d5bef653e8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:18.696557 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e89affbb-45b3-4d54-b589-51d5bef653e8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:18.696985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e89affbb-45b3-4d54-b589-51d5bef653e8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:18.721010 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e89affbb-45b3-4d54-b589-51d5bef653e8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/ips" status: 200 len: 151 microversion: 2.20 time: 0.037242 Jul 07 07:22:18.721653 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 117/225] 10.222.0.62 () {60 vars in 1288 bytes} [Thu Jul 7 07:22:18 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 07 07:22:19.617552 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d0d23daa-f673-42a7-8803-577054976566 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cc8958a-8bf9-4d14-880f-bb692be31594"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:19.619841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d0d23daa-f673-42a7-8803-577054976566 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:19.624999 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=50 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:19.630767 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d0d23daa-f673-42a7-8803-577054976566 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:19.631692 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d0d23daa-f673-42a7-8803-577054976566 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:19.632514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d0d23daa-f673-42a7-8803-577054976566 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:19.633190 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d0d23daa-f673-42a7-8803-577054976566 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:19.660796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-09648f47-f640-49e6-930c-e56b9f81bba1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:19.661389 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-09648f47-f640-49e6-930c-e56b9f81bba1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:19.668743 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09648f47-f640-49e6-930c-e56b9f81bba1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:19.669189 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09648f47-f640-49e6-930c-e56b9f81bba1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:19.669984 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09648f47-f640-49e6-930c-e56b9f81bba1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:19.670412 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-09648f47-f640-49e6-930c-e56b9f81bba1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:19.844964 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-09648f47-f640-49e6-930c-e56b9f81bba1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:19.860389 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-09648f47-f640-49e6-930c-e56b9f81bba1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.203827 Jul 07 07:22:19.863947 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 118/226] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:19 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:20.060799 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d0d23daa-f673-42a7-8803-577054976566 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448045 Jul 07 07:22:20.064604 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 109/227] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:22:19 2022] POST /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-volume_attachments => generated 194 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:22:20.828878 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d1d9e368-e8f5-40b6-ba42-d6d1ac3236d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:20.829709 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d1d9e368-e8f5-40b6-ba42-d6d1ac3236d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:20.837496 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d1d9e368-e8f5-40b6-ba42-d6d1ac3236d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:20.838053 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d1d9e368-e8f5-40b6-ba42-d6d1ac3236d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:20.838899 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d1d9e368-e8f5-40b6-ba42-d6d1ac3236d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:20.839540 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d1d9e368-e8f5-40b6-ba42-d6d1ac3236d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:20.858004 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e069a417-35d8-4da4-a173-4055582e0408 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:20.864911 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e069a417-35d8-4da4-a173-4055582e0408 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:20.865429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e069a417-35d8-4da4-a173-4055582e0408 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:20.874340 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-d1d9e368-e8f5-40b6-ba42-d6d1ac3236d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lazy-loading 'flavor' on Instance uuid 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:22:20.941931 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e069a417-35d8-4da4-a173-4055582e0408 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Going to try to stop instance {{(pid=117787) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 07 07:22:20.998832 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e069a417-35d8-4da4-a173-4055582e0408 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/action" status: 202 len: 0 microversion: 2.1 time: 0.145635 Jul 07 07:22:20.999371 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 110/228] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:22:20 2022] POST /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 07:22:21.008508 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-683216a7-006d-4560-bb7d-cc7dcfe7619e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:21.009500 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-683216a7-006d-4560-bb7d-cc7dcfe7619e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:21.017016 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-683216a7-006d-4560-bb7d-cc7dcfe7619e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:21.017587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-683216a7-006d-4560-bb7d-cc7dcfe7619e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:21.018696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-683216a7-006d-4560-bb7d-cc7dcfe7619e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:21.019383 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-683216a7-006d-4560-bb7d-cc7dcfe7619e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:21.266057 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-683216a7-006d-4560-bb7d-cc7dcfe7619e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:21.275639 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-683216a7-006d-4560-bb7d-cc7dcfe7619e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.271592 Jul 07 07:22:21.276260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 111/229] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:21 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:21.280891 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a278efb5-de49-44b4-9a93-abcaaabbd4d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:21.281860 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a278efb5-de49-44b4-9a93-abcaaabbd4d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:21.288535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a278efb5-de49-44b4-9a93-abcaaabbd4d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:21.289261 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a278efb5-de49-44b4-9a93-abcaaabbd4d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:21.290151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a278efb5-de49-44b4-9a93-abcaaabbd4d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:21.290774 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a278efb5-de49-44b4-9a93-abcaaabbd4d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:21.461125 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a278efb5-de49-44b4-9a93-abcaaabbd4d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:21.478011 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a278efb5-de49-44b4-9a93-abcaaabbd4d5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.200321 Jul 07 07:22:21.488710 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 112/230] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:21 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:22.304586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a6803770-a922-4731-bced-0df34bdb7672 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:22.305550 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a6803770-a922-4731-bced-0df34bdb7672 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:22.317916 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a6803770-a922-4731-bced-0df34bdb7672 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:22.318493 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a6803770-a922-4731-bced-0df34bdb7672 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:22.319512 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a6803770-a922-4731-bced-0df34bdb7672 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:22.319954 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a6803770-a922-4731-bced-0df34bdb7672 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:22.490339 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a6803770-a922-4731-bced-0df34bdb7672 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:22.500000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a6803770-a922-4731-bced-0df34bdb7672 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.200283 Jul 07 07:22:22.501564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 113/231] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:22 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:22.507481 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-158547fc-8251-43b5-87e1-1298dcc84181 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:22.508254 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-158547fc-8251-43b5-87e1-1298dcc84181 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:22.515642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-158547fc-8251-43b5-87e1-1298dcc84181 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:22.516025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-158547fc-8251-43b5-87e1-1298dcc84181 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:22.516920 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-158547fc-8251-43b5-87e1-1298dcc84181 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:22.517679 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-158547fc-8251-43b5-87e1-1298dcc84181 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:22.698035 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-158547fc-8251-43b5-87e1-1298dcc84181 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:22.701958 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:22.708340 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-158547fc-8251-43b5-87e1-1298dcc84181 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.205401 Jul 07 07:22:22.709002 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 114/232] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:22 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:23.518394 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-246c214d-c100-46fe-858a-e5d2386c4f1d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:23.522928 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-246c214d-c100-46fe-858a-e5d2386c4f1d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:23.532392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-246c214d-c100-46fe-858a-e5d2386c4f1d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:23.532925 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-246c214d-c100-46fe-858a-e5d2386c4f1d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:23.533929 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-246c214d-c100-46fe-858a-e5d2386c4f1d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:23.534389 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-246c214d-c100-46fe-858a-e5d2386c4f1d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:23.698311 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-246c214d-c100-46fe-858a-e5d2386c4f1d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:23.706794 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-246c214d-c100-46fe-858a-e5d2386c4f1d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.192497 Jul 07 07:22:23.707691 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 115/233] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:23 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:23.727739 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-054d461a-55bc-4a22-84f4-22220ab1d313 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:23.728436 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-054d461a-55bc-4a22-84f4-22220ab1d313 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:23.735347 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-054d461a-55bc-4a22-84f4-22220ab1d313 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:23.735801 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-054d461a-55bc-4a22-84f4-22220ab1d313 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:23.736595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-054d461a-55bc-4a22-84f4-22220ab1d313 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:23.737366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-054d461a-55bc-4a22-84f4-22220ab1d313 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:23.905084 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-054d461a-55bc-4a22-84f4-22220ab1d313 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:23.914372 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-054d461a-55bc-4a22-84f4-22220ab1d313 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.190694 Jul 07 07:22:23.916271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 116/234] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:23 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:24.725599 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-25637711-d4a4-4cc4-afcf-998aeb831186 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:24.726527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-25637711-d4a4-4cc4-afcf-998aeb831186 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:24.733344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25637711-d4a4-4cc4-afcf-998aeb831186 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:24.734113 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25637711-d4a4-4cc4-afcf-998aeb831186 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:24.734883 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25637711-d4a4-4cc4-afcf-998aeb831186 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:24.735469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25637711-d4a4-4cc4-afcf-998aeb831186 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:24.884416 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-25637711-d4a4-4cc4-afcf-998aeb831186 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:24.892751 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-25637711-d4a4-4cc4-afcf-998aeb831186 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.171301 Jul 07 07:22:24.902481 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 117/235] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:24 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:24.934524 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3c7e37f1-43eb-41b6-8dad-b8674f96f943 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:24.935419 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3c7e37f1-43eb-41b6-8dad-b8674f96f943 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:24.942439 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c7e37f1-43eb-41b6-8dad-b8674f96f943 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:24.942892 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c7e37f1-43eb-41b6-8dad-b8674f96f943 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:24.943666 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c7e37f1-43eb-41b6-8dad-b8674f96f943 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:24.944121 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c7e37f1-43eb-41b6-8dad-b8674f96f943 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:25.093546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3c7e37f1-43eb-41b6-8dad-b8674f96f943 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:25.102577 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3c7e37f1-43eb-41b6-8dad-b8674f96f943 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.172190 Jul 07 07:22:25.103311 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 118/236] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:24 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:25.910440 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-21a99ff0-4ffc-4e35-8b49-d1483826f131 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:25.912121 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-21a99ff0-4ffc-4e35-8b49-d1483826f131 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:25.921402 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-21a99ff0-4ffc-4e35-8b49-d1483826f131 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:25.922175 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-21a99ff0-4ffc-4e35-8b49-d1483826f131 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:25.923068 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-21a99ff0-4ffc-4e35-8b49-d1483826f131 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:25.923571 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-21a99ff0-4ffc-4e35-8b49-d1483826f131 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:26.073889 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-21a99ff0-4ffc-4e35-8b49-d1483826f131 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:26.083627 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-21a99ff0-4ffc-4e35-8b49-d1483826f131 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.177297 Jul 07 07:22:26.084972 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 119/237] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:25 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:26.123421 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2b0c2fce-5449-4a77-8bff-f79807ef67bb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:26.125373 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2b0c2fce-5449-4a77-8bff-f79807ef67bb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:26.135376 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b0c2fce-5449-4a77-8bff-f79807ef67bb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:26.135886 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b0c2fce-5449-4a77-8bff-f79807ef67bb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:26.137035 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b0c2fce-5449-4a77-8bff-f79807ef67bb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:26.137571 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2b0c2fce-5449-4a77-8bff-f79807ef67bb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:26.309987 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2b0c2fce-5449-4a77-8bff-f79807ef67bb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:26.322107 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2b0c2fce-5449-4a77-8bff-f79807ef67bb tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.205602 Jul 07 07:22:26.322699 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 120/238] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:26 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:27.102556 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b20a55ae-2207-445b-9ea4-6d1219ccd10e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:27.104173 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b20a55ae-2207-445b-9ea4-6d1219ccd10e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:27.113267 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b20a55ae-2207-445b-9ea4-6d1219ccd10e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:27.113917 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b20a55ae-2207-445b-9ea4-6d1219ccd10e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:27.114745 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b20a55ae-2207-445b-9ea4-6d1219ccd10e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:27.115551 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b20a55ae-2207-445b-9ea4-6d1219ccd10e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:27.278952 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b20a55ae-2207-445b-9ea4-6d1219ccd10e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:27.287379 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b20a55ae-2207-445b-9ea4-6d1219ccd10e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.189365 Jul 07 07:22:27.287952 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 121/239] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:27 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:27.341553 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e0e333c2-af25-4a78-af8b-d34762436b16 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:27.342152 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e0e333c2-af25-4a78-af8b-d34762436b16 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:27.350227 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e0e333c2-af25-4a78-af8b-d34762436b16 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:27.350953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e0e333c2-af25-4a78-af8b-d34762436b16 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:27.351931 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e0e333c2-af25-4a78-af8b-d34762436b16 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:27.352379 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e0e333c2-af25-4a78-af8b-d34762436b16 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:27.502887 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e0e333c2-af25-4a78-af8b-d34762436b16 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:27.513576 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e0e333c2-af25-4a78-af8b-d34762436b16 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.176450 Jul 07 07:22:27.514409 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 122/240] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:27 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:28.304210 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-81d7aecc-75d4-425d-a3b7-430d8157c21d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:28.305126 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-81d7aecc-75d4-425d-a3b7-430d8157c21d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:28.312862 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81d7aecc-75d4-425d-a3b7-430d8157c21d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:28.313467 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81d7aecc-75d4-425d-a3b7-430d8157c21d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:28.314253 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81d7aecc-75d4-425d-a3b7-430d8157c21d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:28.314705 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81d7aecc-75d4-425d-a3b7-430d8157c21d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:28.482640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-81d7aecc-75d4-425d-a3b7-430d8157c21d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:28.493651 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-81d7aecc-75d4-425d-a3b7-430d8157c21d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.193477 Jul 07 07:22:28.503904 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 123/241] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:28 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:28.533912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-da7bdd76-dc3c-4707-b54d-5413fc28774a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:28.535137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-da7bdd76-dc3c-4707-b54d-5413fc28774a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:28.543234 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da7bdd76-dc3c-4707-b54d-5413fc28774a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:28.543234 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da7bdd76-dc3c-4707-b54d-5413fc28774a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:28.544395 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da7bdd76-dc3c-4707-b54d-5413fc28774a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:28.544977 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da7bdd76-dc3c-4707-b54d-5413fc28774a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:28.688523 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da7bdd76-dc3c-4707-b54d-5413fc28774a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:28.697453 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-da7bdd76-dc3c-4707-b54d-5413fc28774a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.168845 Jul 07 07:22:28.698079 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 124/242] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:28 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:28.836231 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-908a79d2-0cfb-4d97-95c1-070e822e8a57 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: .version_select at 0x7fccfa504940>, body: {"keypair": {"name": "tempest-keypair-1553152927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTBoWL84OmCMNTCWPNtbO4O0Zm27C9QbZL7fcm0GM/O6j3n+CsL8eQAP0/veHgqFPwTsBSHZ8qujgG7CuzXpEaPGKYxJKtGXSqHCq2A5jmGYjrD2IHZTbIAjFH8y0wOVA=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:28.851501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-908a79d2-0cfb-4d97-95c1-070e822e8a57 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for project 883f7310b404427fa3ddda37a8d04acc. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:22:28.855501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-908a79d2-0cfb-4d97-95c1-070e822e8a57 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for user 58366850e234491cafe268bb56e9e3a1 and project 883f7310b404427fa3ddda37a8d04acc. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:22:28.880581 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-908a79d2-0cfb-4d97-95c1-070e822e8a57 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048237 Jul 07 07:22:28.881274 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 125/243] 10.222.0.62 () {60 vars in 1158 bytes} [Thu Jul 7 07:22:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:22:29.516889 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2f1e382b-5ed6-49ea-ac74-002cc53d0261 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:29.518175 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2f1e382b-5ed6-49ea-ac74-002cc53d0261 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:29.526607 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f1e382b-5ed6-49ea-ac74-002cc53d0261 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:29.527088 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f1e382b-5ed6-49ea-ac74-002cc53d0261 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:29.527923 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f1e382b-5ed6-49ea-ac74-002cc53d0261 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:29.528378 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f1e382b-5ed6-49ea-ac74-002cc53d0261 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:29.775556 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2f1e382b-5ed6-49ea-ac74-002cc53d0261 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:29.786742 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2f1e382b-5ed6-49ea-ac74-002cc53d0261 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.275078 Jul 07 07:22:29.796844 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 126/244] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:29 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:29.802221 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f9a069b6-2c26-4cf4-87ef-3be4ea459d0d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:29.802861 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f9a069b6-2c26-4cf4-87ef-3be4ea459d0d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:29.813243 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9a069b6-2c26-4cf4-87ef-3be4ea459d0d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:29.813243 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9a069b6-2c26-4cf4-87ef-3be4ea459d0d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:29.813243 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9a069b6-2c26-4cf4-87ef-3be4ea459d0d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:29.815920 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9a069b6-2c26-4cf4-87ef-3be4ea459d0d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:29.985550 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f9a069b6-2c26-4cf4-87ef-3be4ea459d0d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:29.997769 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f9a069b6-2c26-4cf4-87ef-3be4ea459d0d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.199427 Jul 07 07:22:29.998885 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 127/245] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:29 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:30.804691 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-64bb6b62-51cb-4d9e-b4da-e292b179293d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:30.806329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-64bb6b62-51cb-4d9e-b4da-e292b179293d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:30.816902 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64bb6b62-51cb-4d9e-b4da-e292b179293d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:30.817889 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64bb6b62-51cb-4d9e-b4da-e292b179293d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:30.819166 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64bb6b62-51cb-4d9e-b4da-e292b179293d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:30.819435 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-64bb6b62-51cb-4d9e-b4da-e292b179293d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:30.833624 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:30.999411 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-64bb6b62-51cb-4d9e-b4da-e292b179293d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:31.004677 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:31.008474 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-64bb6b62-51cb-4d9e-b4da-e292b179293d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.207885 Jul 07 07:22:31.009080 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 128/246] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:30 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:31.016982 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1146741079", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9578812b-5d60-45a0-af5c-eccba67aa04b"}], "security_groups": [{"name": "tempest-securitygroup--987037943"}], "key_name": "tempest-keypair-1553152927", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:31.961586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] validate_networks() for [('9578812b-5d60-45a0-af5c-eccba67aa04b', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:22:32.032776 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d1d9e368-e8f5-40b6-ba42-d6d1ac3236d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "POST /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/action" status: 202 len: 0 microversion: 2.20 time: 11.207878 Jul 07 07:22:32.036115 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 119/247] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Jul 7 07:22:20 2022] POST /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/action => generated 0 bytes in 11212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:22:32.045674 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6e0645cc-2614-4ab3-892c-392895dab199 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:32.047177 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6e0645cc-2614-4ab3-892c-392895dab199 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:32.060960 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e0645cc-2614-4ab3-892c-392895dab199 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:32.062593 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e0645cc-2614-4ab3-892c-392895dab199 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:32.064002 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e0645cc-2614-4ab3-892c-392895dab199 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:32.064599 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e0645cc-2614-4ab3-892c-392895dab199 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:32.283181 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6e0645cc-2614-4ab3-892c-392895dab199 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:32.293660 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6e0645cc-2614-4ab3-892c-392895dab199 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.255505 Jul 07 07:22:32.294541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 120/248] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:32 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:32.302770 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-023c233c-150b-4010-a317-056f4ae11cfc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:32.303387 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-023c233c-150b-4010-a317-056f4ae11cfc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:32.311281 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-023c233c-150b-4010-a317-056f4ae11cfc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:32.312583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-023c233c-150b-4010-a317-056f4ae11cfc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:32.313577 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-023c233c-150b-4010-a317-056f4ae11cfc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:32.314158 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-023c233c-150b-4010-a317-056f4ae11cfc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:32.548722 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-023c233c-150b-4010-a317-056f4ae11cfc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:32.560062 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:22:32.560596 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:22:32.560947 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:22:32.561402 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-023c233c-150b-4010-a317-056f4ae11cfc tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.264802 Jul 07 07:22:32.561905 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:22:32.562169 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:22:32.563871 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 121/249] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:32 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:32.572206 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-194ade9e-91a6-4f39-8f76-6e9de53b858f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:32.573680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-194ade9e-91a6-4f39-8f76-6e9de53b858f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:32.586995 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:32.587932 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:32.588561 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-194ade9e-91a6-4f39-8f76-6e9de53b858f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:32.589159 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-194ade9e-91a6-4f39-8f76-6e9de53b858f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:32.589305 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:32.590017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:32.590369 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-194ade9e-91a6-4f39-8f76-6e9de53b858f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:32.591477 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-194ade9e-91a6-4f39-8f76-6e9de53b858f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:32.611069 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for project 883f7310b404427fa3ddda37a8d04acc. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:22:32.616814 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for user 58366850e234491cafe268bb56e9e3a1 and project 883f7310b404427fa3ddda37a8d04acc. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:22:32.630987 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:22:32.633646 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:22:32.698148 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-87a64be8-3419-4794-a320-679dcd75d36d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.687755 Jul 07 07:22:32.699569 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 129/250] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:22:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:22:32.711316 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-31b7770b-5013-491c-91ca-513d030ef4d0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:32.711940 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-31b7770b-5013-491c-91ca-513d030ef4d0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:32.852858 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-31b7770b-5013-491c-91ca-513d030ef4d0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:32.874253 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-31b7770b-5013-491c-91ca-513d030ef4d0 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1242 microversion: 2.1 time: 0.167107 Jul 07 07:22:32.874833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 130/251] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:32 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1242 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:32.908611 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-194ade9e-91a6-4f39-8f76-6e9de53b858f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:32.917095 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-194ade9e-91a6-4f39-8f76-6e9de53b858f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:32.918662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-194ade9e-91a6-4f39-8f76-6e9de53b858f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:32.919861 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-194ade9e-91a6-4f39-8f76-6e9de53b858f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.353541 Jul 07 07:22:32.920408 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 122/252] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:32 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:33.317847 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5f559384-97db-4e43-a959-3fc93e092f7e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:33.319472 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5f559384-97db-4e43-a959-3fc93e092f7e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:33.329380 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5f559384-97db-4e43-a959-3fc93e092f7e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:33.330533 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5f559384-97db-4e43-a959-3fc93e092f7e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:33.332107 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5f559384-97db-4e43-a959-3fc93e092f7e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:33.332779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5f559384-97db-4e43-a959-3fc93e092f7e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:33.515725 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5f559384-97db-4e43-a959-3fc93e092f7e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:33.525690 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5f559384-97db-4e43-a959-3fc93e092f7e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.214710 Jul 07 07:22:33.526293 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 131/253] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:33 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:33.582436 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-23aa935a-96a1-42be-bbec-541f96a27bec tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:33.583665 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-23aa935a-96a1-42be-bbec-541f96a27bec tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:33.590634 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23aa935a-96a1-42be-bbec-541f96a27bec tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:33.591315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23aa935a-96a1-42be-bbec-541f96a27bec tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:33.592325 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23aa935a-96a1-42be-bbec-541f96a27bec tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:33.592996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23aa935a-96a1-42be-bbec-541f96a27bec tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:33.782242 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-23aa935a-96a1-42be-bbec-541f96a27bec tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:33.791099 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-23aa935a-96a1-42be-bbec-541f96a27bec tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.213166 Jul 07 07:22:33.792177 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 123/254] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:33 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:33.891573 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e09d658a-071f-40f7-9255-756b4fa89e5f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:33.892497 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e09d658a-071f-40f7-9255-756b4fa89e5f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:33.900675 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e09d658a-071f-40f7-9255-756b4fa89e5f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:33.901350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e09d658a-071f-40f7-9255-756b4fa89e5f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:33.902314 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e09d658a-071f-40f7-9255-756b4fa89e5f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:33.902912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e09d658a-071f-40f7-9255-756b4fa89e5f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:33.939961 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-342fab15-d9b9-4d48-bce3-716cce8a3885 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:33.940850 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-342fab15-d9b9-4d48-bce3-716cce8a3885 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:33.954291 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-342fab15-d9b9-4d48-bce3-716cce8a3885 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:33.954771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-342fab15-d9b9-4d48-bce3-716cce8a3885 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:33.955905 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-342fab15-d9b9-4d48-bce3-716cce8a3885 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:33.960056 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-342fab15-d9b9-4d48-bce3-716cce8a3885 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:33.975899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e09d658a-071f-40f7-9255-756b4fa89e5f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:33.985298 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e09d658a-071f-40f7-9255-756b4fa89e5f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1294 microversion: 2.1 time: 0.097586 Jul 07 07:22:33.986250 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 132/255] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:33 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:34.119057 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-342fab15-d9b9-4d48-bce3-716cce8a3885 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:34.127445 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-342fab15-d9b9-4d48-bce3-716cce8a3885 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:34.129284 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-342fab15-d9b9-4d48-bce3-716cce8a3885 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:34.130702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-342fab15-d9b9-4d48-bce3-716cce8a3885 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.195839 Jul 07 07:22:34.131267 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 124/256] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:33 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:22:34.543635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e5883bf9-6ff2-486e-9e48-883a418c40f4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:34.544376 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e5883bf9-6ff2-486e-9e48-883a418c40f4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:34.552095 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5883bf9-6ff2-486e-9e48-883a418c40f4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:34.552684 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5883bf9-6ff2-486e-9e48-883a418c40f4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:34.553698 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5883bf9-6ff2-486e-9e48-883a418c40f4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:34.554128 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e5883bf9-6ff2-486e-9e48-883a418c40f4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:34.734512 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e5883bf9-6ff2-486e-9e48-883a418c40f4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:34.745329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e5883bf9-6ff2-486e-9e48-883a418c40f4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.205739 Jul 07 07:22:34.746478 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 133/257] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:34 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:34.812122 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f1e497f7-abaa-4a72-b1ef-8fc8a2ca98b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:34.812750 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f1e497f7-abaa-4a72-b1ef-8fc8a2ca98b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:34.828196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1e497f7-abaa-4a72-b1ef-8fc8a2ca98b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:34.829469 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1e497f7-abaa-4a72-b1ef-8fc8a2ca98b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:34.830216 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1e497f7-abaa-4a72-b1ef-8fc8a2ca98b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:34.830722 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1e497f7-abaa-4a72-b1ef-8fc8a2ca98b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:35.005298 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-edc0d91b-f759-4cc4-b086-9016d53afb23 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:35.006375 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-edc0d91b-f759-4cc4-b086-9016d53afb23 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:35.014406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edc0d91b-f759-4cc4-b086-9016d53afb23 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:35.015159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edc0d91b-f759-4cc4-b086-9016d53afb23 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:35.016183 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edc0d91b-f759-4cc4-b086-9016d53afb23 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:35.016804 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edc0d91b-f759-4cc4-b086-9016d53afb23 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:35.022713 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:35.059610 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f1e497f7-abaa-4a72-b1ef-8fc8a2ca98b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:35.072471 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f1e497f7-abaa-4a72-b1ef-8fc8a2ca98b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1520 microversion: 2.1 time: 0.266914 Jul 07 07:22:35.073135 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 125/258] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:34 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:35.098368 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-edc0d91b-f759-4cc4-b086-9016d53afb23 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:35.121674 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-edc0d91b-f759-4cc4-b086-9016d53afb23 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1300 microversion: 2.1 time: 0.120206 Jul 07 07:22:35.122616 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 134/259] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:35 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:35.150627 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c4a7b960-e37d-42dc-8845-a81e1ea8f05b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:35.151249 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c4a7b960-e37d-42dc-8845-a81e1ea8f05b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:35.157806 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4a7b960-e37d-42dc-8845-a81e1ea8f05b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:35.158570 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4a7b960-e37d-42dc-8845-a81e1ea8f05b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:35.159350 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4a7b960-e37d-42dc-8845-a81e1ea8f05b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:35.159792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4a7b960-e37d-42dc-8845-a81e1ea8f05b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:35.313497 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c4a7b960-e37d-42dc-8845-a81e1ea8f05b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:35.324516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c4a7b960-e37d-42dc-8845-a81e1ea8f05b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:35.326179 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c4a7b960-e37d-42dc-8845-a81e1ea8f05b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:35.327392 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c4a7b960-e37d-42dc-8845-a81e1ea8f05b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.180820 Jul 07 07:22:35.328094 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 126/260] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:35 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:22:35.764712 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d69b05de-890b-466a-b015-1d2482d21d49 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:35.765525 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d69b05de-890b-466a-b015-1d2482d21d49 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:35.771682 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d69b05de-890b-466a-b015-1d2482d21d49 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:35.772113 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d69b05de-890b-466a-b015-1d2482d21d49 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:35.772907 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d69b05de-890b-466a-b015-1d2482d21d49 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:35.773509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d69b05de-890b-466a-b015-1d2482d21d49 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:35.909271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d69b05de-890b-466a-b015-1d2482d21d49 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:35.917784 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d69b05de-890b-466a-b015-1d2482d21d49 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1722 microversion: 2.1 time: 0.158219 Jul 07 07:22:35.918362 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 135/261] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:35 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:36.090339 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4a624961-f989-4151-a6e7-b58ec557a40a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:36.090952 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4a624961-f989-4151-a6e7-b58ec557a40a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:36.097975 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a624961-f989-4151-a6e7-b58ec557a40a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:36.098493 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a624961-f989-4151-a6e7-b58ec557a40a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:36.099287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a624961-f989-4151-a6e7-b58ec557a40a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:36.099700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a624961-f989-4151-a6e7-b58ec557a40a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:36.139952 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b2639f9c-e264-4bee-ae1b-d4ed83df1fe3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:36.141108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b2639f9c-e264-4bee-ae1b-d4ed83df1fe3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:36.149121 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2639f9c-e264-4bee-ae1b-d4ed83df1fe3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:36.149697 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2639f9c-e264-4bee-ae1b-d4ed83df1fe3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:36.150634 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2639f9c-e264-4bee-ae1b-d4ed83df1fe3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:36.151186 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2639f9c-e264-4bee-ae1b-d4ed83df1fe3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:36.424206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b2639f9c-e264-4bee-ae1b-d4ed83df1fe3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:36.432960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b2639f9c-e264-4bee-ae1b-d4ed83df1fe3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1300 microversion: 2.1 time: 0.297293 Jul 07 07:22:36.434153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 136/262] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:36 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1300 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:36.440260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3c768c8f-a2d9-43fb-8621-d069fbcb96fe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:36.441049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3c768c8f-a2d9-43fb-8621-d069fbcb96fe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:36.465751 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c768c8f-a2d9-43fb-8621-d069fbcb96fe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:36.469869 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c768c8f-a2d9-43fb-8621-d069fbcb96fe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:36.473429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c768c8f-a2d9-43fb-8621-d069fbcb96fe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:36.473899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c768c8f-a2d9-43fb-8621-d069fbcb96fe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:36.547973 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4a624961-f989-4151-a6e7-b58ec557a40a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:36.556817 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4a624961-f989-4151-a6e7-b58ec557a40a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1500 microversion: 2.1 time: 0.470432 Jul 07 07:22:36.557504 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 127/263] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:36 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1500 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:36.574588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a377ffc2-42c0-41d1-b2c7-f8f1b84bc2bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:36.575382 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a377ffc2-42c0-41d1-b2c7-f8f1b84bc2bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:36.582594 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a377ffc2-42c0-41d1-b2c7-f8f1b84bc2bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:36.583372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a377ffc2-42c0-41d1-b2c7-f8f1b84bc2bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:36.584260 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a377ffc2-42c0-41d1-b2c7-f8f1b84bc2bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:36.584909 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a377ffc2-42c0-41d1-b2c7-f8f1b84bc2bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:36.774954 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3c768c8f-a2d9-43fb-8621-d069fbcb96fe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:36.783688 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3c768c8f-a2d9-43fb-8621-d069fbcb96fe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:36.785535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3c768c8f-a2d9-43fb-8621-d069fbcb96fe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:36.786836 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3c768c8f-a2d9-43fb-8621-d069fbcb96fe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.351297 Jul 07 07:22:36.787375 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 137/264] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:36 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:36.822967 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a377ffc2-42c0-41d1-b2c7-f8f1b84bc2bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:36.831271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a377ffc2-42c0-41d1-b2c7-f8f1b84bc2bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1516 microversion: 2.1 time: 0.261639 Jul 07 07:22:36.831844 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 128/265] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:36 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1516 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:36.937427 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d02795c2-5830-4bf2-ad5f-3c8e663edd68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:36.938155 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d02795c2-5830-4bf2-ad5f-3c8e663edd68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:36.946652 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d02795c2-5830-4bf2-ad5f-3c8e663edd68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:36.947098 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d02795c2-5830-4bf2-ad5f-3c8e663edd68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:36.947979 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d02795c2-5830-4bf2-ad5f-3c8e663edd68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:36.948968 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d02795c2-5830-4bf2-ad5f-3c8e663edd68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:37.197530 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d02795c2-5830-4bf2-ad5f-3c8e663edd68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:37.210671 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d02795c2-5830-4bf2-ad5f-3c8e663edd68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1699 microversion: 2.1 time: 0.278933 Jul 07 07:22:37.211926 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 138/266] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:36 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1699 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:37.230867 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3bba532a-7132-466c-836c-0d53d719f6d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:37.240453 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3bba532a-7132-466c-836c-0d53d719f6d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:37.240453 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3bba532a-7132-466c-836c-0d53d719f6d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:37.323575 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3bba532a-7132-466c-836c-0d53d719f6d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Going to try to start instance {{(pid=117788) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 07 07:22:37.457315 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-843ddb72-d3b7-4b01-8821-c04d3295f547 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:37.461031 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-843ddb72-d3b7-4b01-8821-c04d3295f547 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:37.471748 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-843ddb72-d3b7-4b01-8821-c04d3295f547 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:37.473625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-843ddb72-d3b7-4b01-8821-c04d3295f547 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:37.479082 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-843ddb72-d3b7-4b01-8821-c04d3295f547 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:37.479846 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-843ddb72-d3b7-4b01-8821-c04d3295f547 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:37.544003 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3bba532a-7132-466c-836c-0d53d719f6d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/action" status: 202 len: 0 microversion: 2.1 time: 0.318148 Jul 07 07:22:37.544525 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 129/267] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:22:37 2022] POST /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:22:37.553376 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bb86553b-2413-4628-927a-029b87c54bbd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:37.554069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bb86553b-2413-4628-927a-029b87c54bbd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:37.560561 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb86553b-2413-4628-927a-029b87c54bbd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:37.560998 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb86553b-2413-4628-927a-029b87c54bbd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:37.562214 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb86553b-2413-4628-927a-029b87c54bbd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:37.562801 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb86553b-2413-4628-927a-029b87c54bbd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:37.839977 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-843ddb72-d3b7-4b01-8821-c04d3295f547 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:37.849731 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-843ddb72-d3b7-4b01-8821-c04d3295f547 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1367 microversion: 2.1 time: 0.402409 Jul 07 07:22:37.850340 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 139/268] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:37 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:37.855174 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2056d494-e012-4c5c-9558-22c1528831bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:37.856190 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2056d494-e012-4c5c-9558-22c1528831bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:37.863928 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2056d494-e012-4c5c-9558-22c1528831bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:37.864777 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2056d494-e012-4c5c-9558-22c1528831bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:37.865867 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2056d494-e012-4c5c-9558-22c1528831bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:37.866552 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2056d494-e012-4c5c-9558-22c1528831bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:37.880184 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bb86553b-2413-4628-927a-029b87c54bbd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:37.906562 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bb86553b-2413-4628-927a-029b87c54bbd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1708 microversion: 2.1 time: 0.357646 Jul 07 07:22:37.911391 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 130/269] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:37 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1708 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:38.196216 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2056d494-e012-4c5c-9558-22c1528831bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:38.210347 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2056d494-e012-4c5c-9558-22c1528831bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:38.213349 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2056d494-e012-4c5c-9558-22c1528831bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:38.215123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2056d494-e012-4c5c-9558-22c1528831bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.363866 Jul 07 07:22:38.217783 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 140/270] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:37 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:38.357601 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-778b2532-86b0-42ac-9b9e-e5e14a753262 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:38.359303 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-778b2532-86b0-42ac-9b9e-e5e14a753262 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:38.367192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-778b2532-86b0-42ac-9b9e-e5e14a753262 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:38.368249 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-778b2532-86b0-42ac-9b9e-e5e14a753262 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:38.369710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-778b2532-86b0-42ac-9b9e-e5e14a753262 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:38.370121 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-778b2532-86b0-42ac-9b9e-e5e14a753262 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:38.417537 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-778b2532-86b0-42ac-9b9e-e5e14a753262 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lazy-loading 'flavor' on Instance uuid f3f038b4-3e52-4a94-833f-708642a6fe10 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:22:38.513722 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-53d74e64-58c7-4e84-8ade-adf86f765996 req-db590c66-fec4-4511-83b1-be3366ae412d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e7489d-0481-4cfe-8e7d-4d9bd447f492", "tag": "2adf9380-5032-4847-a6c2-7a57d1b430dd"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:38.530830 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-53d74e64-58c7-4e84-8ade-adf86f765996 req-db590c66-fec4-4511-83b1-be3366ae412d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:38.535532 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-53d74e64-58c7-4e84-8ade-adf86f765996 req-db590c66-fec4-4511-83b1-be3366ae412d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:38.568206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-53d74e64-58c7-4e84-8ade-adf86f765996 req-db590c66-fec4-4511-83b1-be3366ae412d service nova] Creating event network-changed:2adf9380-5032-4847-a6c2-7a57d1b430dd for instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 on hv-cinder-82660 Jul 07 07:22:38.573903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-53d74e64-58c7-4e84-8ade-adf86f765996 req-db590c66-fec4-4511-83b1-be3366ae412d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066673 Jul 07 07:22:38.575167 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 141/271] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:22:38.594085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-778b2532-86b0-42ac-9b9e-e5e14a753262 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10/action" status: 200 len: 32 microversion: 2.1 time: 0.240785 Jul 07 07:22:38.594984 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 131/272] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:22:38 2022] POST /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10/action => generated 32 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 07:22:38.604811 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0fe6e6cc-5dcd-464a-abb6-ee629112e064 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:38.605776 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0fe6e6cc-5dcd-464a-abb6-ee629112e064 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:38.624238 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fe6e6cc-5dcd-464a-abb6-ee629112e064 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:38.624808 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fe6e6cc-5dcd-464a-abb6-ee629112e064 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:38.626007 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fe6e6cc-5dcd-464a-abb6-ee629112e064 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:38.626687 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0fe6e6cc-5dcd-464a-abb6-ee629112e064 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:38.869591 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c3ff1d65-4420-41db-94b7-3809c9a46bfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:38.870482 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c3ff1d65-4420-41db-94b7-3809c9a46bfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:38.877802 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0fe6e6cc-5dcd-464a-abb6-ee629112e064 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:38.884889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c3ff1d65-4420-41db-94b7-3809c9a46bfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:38.889617 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0fe6e6cc-5dcd-464a-abb6-ee629112e064 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.289393 Jul 07 07:22:38.890789 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 142/273] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:38 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:38.899756 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c3ff1d65-4420-41db-94b7-3809c9a46bfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:38.901807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c3ff1d65-4420-41db-94b7-3809c9a46bfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:38.902372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c3ff1d65-4420-41db-94b7-3809c9a46bfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:38.949560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3c1668a3-9f01-46ad-9210-f82301ccaeba tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:38.950999 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3c1668a3-9f01-46ad-9210-f82301ccaeba tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:38.969183 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c1668a3-9f01-46ad-9210-f82301ccaeba tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:38.969684 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c1668a3-9f01-46ad-9210-f82301ccaeba tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:38.970500 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c1668a3-9f01-46ad-9210-f82301ccaeba tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:38.974870 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c1668a3-9f01-46ad-9210-f82301ccaeba tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:39.169170 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c3ff1d65-4420-41db-94b7-3809c9a46bfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:39.177590 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c3ff1d65-4420-41db-94b7-3809c9a46bfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1367 microversion: 2.1 time: 0.313597 Jul 07 07:22:39.178449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 132/274] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:38 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:39.225615 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3c1668a3-9f01-46ad-9210-f82301ccaeba tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:39.234539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3c1668a3-9f01-46ad-9210-f82301ccaeba tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1708 microversion: 2.1 time: 0.301250 Jul 07 07:22:39.235103 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 143/275] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:38 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1708 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:39.235783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-827d64af-164a-44d1-b436-6785f712f500 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:39.237892 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-827d64af-164a-44d1-b436-6785f712f500 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:39.246594 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-827d64af-164a-44d1-b436-6785f712f500 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:39.247070 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-827d64af-164a-44d1-b436-6785f712f500 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:39.247872 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-827d64af-164a-44d1-b436-6785f712f500 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:39.248375 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-827d64af-164a-44d1-b436-6785f712f500 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:39.268619 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:39.388384 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-827d64af-164a-44d1-b436-6785f712f500 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:39.398224 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-827d64af-164a-44d1-b436-6785f712f500 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:39.399849 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-827d64af-164a-44d1-b436-6785f712f500 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:39.401077 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-827d64af-164a-44d1-b436-6785f712f500 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.169401 Jul 07 07:22:39.411672 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 133/276] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:39 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:22:39.907668 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d48cf778-473e-4355-a7df-cccd8bfa85bf tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:39.908459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d48cf778-473e-4355-a7df-cccd8bfa85bf tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:39.914910 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d48cf778-473e-4355-a7df-cccd8bfa85bf tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:39.915362 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d48cf778-473e-4355-a7df-cccd8bfa85bf tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:39.916138 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d48cf778-473e-4355-a7df-cccd8bfa85bf tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:39.916569 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d48cf778-473e-4355-a7df-cccd8bfa85bf tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:40.057574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d48cf778-473e-4355-a7df-cccd8bfa85bf tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:40.066925 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d48cf778-473e-4355-a7df-cccd8bfa85bf tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.163358 Jul 07 07:22:40.067592 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 144/277] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:39 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:40.198236 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ad0e409b-a0c6-4626-9e7e-7ee9c3597da9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:40.199161 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ad0e409b-a0c6-4626-9e7e-7ee9c3597da9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:40.215867 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad0e409b-a0c6-4626-9e7e-7ee9c3597da9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:40.216528 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad0e409b-a0c6-4626-9e7e-7ee9c3597da9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:40.218849 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad0e409b-a0c6-4626-9e7e-7ee9c3597da9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:40.219862 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad0e409b-a0c6-4626-9e7e-7ee9c3597da9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:40.253162 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1ec9f20b-d907-42c4-bbf7-734e946a550a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:40.253765 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1ec9f20b-d907-42c4-bbf7-734e946a550a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:40.257523 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:40.261870 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec9f20b-d907-42c4-bbf7-734e946a550a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:40.262308 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec9f20b-d907-42c4-bbf7-734e946a550a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:40.263079 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec9f20b-d907-42c4-bbf7-734e946a550a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:40.263675 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec9f20b-d907-42c4-bbf7-734e946a550a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:40.462248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ad0e409b-a0c6-4626-9e7e-7ee9c3597da9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:40.469974 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ad0e409b-a0c6-4626-9e7e-7ee9c3597da9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1367 microversion: 2.1 time: 0.278475 Jul 07 07:22:40.470571 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 134/278] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:40 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:40.479585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4cca47fd-a0f8-40dd-acaa-87f2aa24e6bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:40.479585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4cca47fd-a0f8-40dd-acaa-87f2aa24e6bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:40.479921 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1ec9f20b-d907-42c4-bbf7-734e946a550a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:40.483685 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cca47fd-a0f8-40dd-acaa-87f2aa24e6bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:40.484266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cca47fd-a0f8-40dd-acaa-87f2aa24e6bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:40.485252 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cca47fd-a0f8-40dd-acaa-87f2aa24e6bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:40.485758 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4cca47fd-a0f8-40dd-acaa-87f2aa24e6bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:40.486562 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1ec9f20b-d907-42c4-bbf7-734e946a550a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1712 microversion: 2.1 time: 0.237261 Jul 07 07:22:40.487237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 145/279] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:40 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1712 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:40.689292 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4cca47fd-a0f8-40dd-acaa-87f2aa24e6bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:40.699422 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4cca47fd-a0f8-40dd-acaa-87f2aa24e6bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:40.701759 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4cca47fd-a0f8-40dd-acaa-87f2aa24e6bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:40.703474 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4cca47fd-a0f8-40dd-acaa-87f2aa24e6bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.231674 Jul 07 07:22:40.704360 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 135/280] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:40 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:41.084607 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d7428c41-6041-44b5-a4fb-091eeb42fb50 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:41.085234 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d7428c41-6041-44b5-a4fb-091eeb42fb50 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:41.091646 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7428c41-6041-44b5-a4fb-091eeb42fb50 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:41.092119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7428c41-6041-44b5-a4fb-091eeb42fb50 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:41.092950 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7428c41-6041-44b5-a4fb-091eeb42fb50 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:41.093490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7428c41-6041-44b5-a4fb-091eeb42fb50 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:41.276949 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d7428c41-6041-44b5-a4fb-091eeb42fb50 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:41.289987 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d7428c41-6041-44b5-a4fb-091eeb42fb50 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.209420 Jul 07 07:22:41.290576 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 146/281] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:41 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:41.487735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e5f85622-57fa-44ba-a038-6c3fef0c5c30 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:41.489159 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e5f85622-57fa-44ba-a038-6c3fef0c5c30 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:41.495588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5f85622-57fa-44ba-a038-6c3fef0c5c30 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:41.496294 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5f85622-57fa-44ba-a038-6c3fef0c5c30 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:41.497410 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5f85622-57fa-44ba-a038-6c3fef0c5c30 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:41.498038 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5f85622-57fa-44ba-a038-6c3fef0c5c30 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:41.723115 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0551e6e8-ad19-4132-a87c-de9ce364ce77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:41.723963 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0551e6e8-ad19-4132-a87c-de9ce364ce77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:41.730527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0551e6e8-ad19-4132-a87c-de9ce364ce77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:41.731233 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0551e6e8-ad19-4132-a87c-de9ce364ce77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:41.732063 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0551e6e8-ad19-4132-a87c-de9ce364ce77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:41.732500 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0551e6e8-ad19-4132-a87c-de9ce364ce77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:41.759800 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e5f85622-57fa-44ba-a038-6c3fef0c5c30 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:41.772528 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e5f85622-57fa-44ba-a038-6c3fef0c5c30 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1367 microversion: 2.1 time: 0.288285 Jul 07 07:22:41.773822 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 136/282] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:41 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:41.965428 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0551e6e8-ad19-4132-a87c-de9ce364ce77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:41.981852 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0551e6e8-ad19-4132-a87c-de9ce364ce77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:41.983914 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0551e6e8-ad19-4132-a87c-de9ce364ce77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:41.985239 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0551e6e8-ad19-4132-a87c-de9ce364ce77 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.266283 Jul 07 07:22:41.985940 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 147/283] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:41 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:42.308215 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-97016849-01a8-4c11-a508-e48734719d0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:42.308835 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-97016849-01a8-4c11-a508-e48734719d0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:42.315979 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-97016849-01a8-4c11-a508-e48734719d0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:42.316432 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-97016849-01a8-4c11-a508-e48734719d0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:42.317208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-97016849-01a8-4c11-a508-e48734719d0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:42.317692 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-97016849-01a8-4c11-a508-e48734719d0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:42.788662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-97016849-01a8-4c11-a508-e48734719d0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:42.790470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8746427f-b48b-4d0f-93a5-eb053ec19e94 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:42.791184 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8746427f-b48b-4d0f-93a5-eb053ec19e94 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:42.794710 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:42.797957 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-97016849-01a8-4c11-a508-e48734719d0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.494394 Jul 07 07:22:42.798911 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 137/284] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:42 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:42.800690 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8746427f-b48b-4d0f-93a5-eb053ec19e94 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:42.801265 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8746427f-b48b-4d0f-93a5-eb053ec19e94 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:42.802093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8746427f-b48b-4d0f-93a5-eb053ec19e94 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:42.802602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8746427f-b48b-4d0f-93a5-eb053ec19e94 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:42.867903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=12 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:43.004322 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-22fe21ca-fcea-47fe-a72c-21f1f5764d46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:43.005106 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-22fe21ca-fcea-47fe-a72c-21f1f5764d46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:43.011518 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22fe21ca-fcea-47fe-a72c-21f1f5764d46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:43.012088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22fe21ca-fcea-47fe-a72c-21f1f5764d46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:43.013081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22fe21ca-fcea-47fe-a72c-21f1f5764d46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:43.013754 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22fe21ca-fcea-47fe-a72c-21f1f5764d46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:43.069506 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8746427f-b48b-4d0f-93a5-eb053ec19e94 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:43.077527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8746427f-b48b-4d0f-93a5-eb053ec19e94 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1367 microversion: 2.1 time: 0.291013 Jul 07 07:22:43.084676 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 148/285] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:42 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:43.249096 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-22fe21ca-fcea-47fe-a72c-21f1f5764d46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:43.259996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-22fe21ca-fcea-47fe-a72c-21f1f5764d46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:43.262333 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-22fe21ca-fcea-47fe-a72c-21f1f5764d46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:43.263715 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-22fe21ca-fcea-47fe-a72c-21f1f5764d46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.263460 Jul 07 07:22:43.264710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 138/286] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:42 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:22:43.816373 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-24d84ba1-f677-4870-b286-9e51fe80943d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:43.817131 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-24d84ba1-f677-4870-b286-9e51fe80943d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:43.824553 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-24d84ba1-f677-4870-b286-9e51fe80943d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:43.825065 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-24d84ba1-f677-4870-b286-9e51fe80943d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:43.825992 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-24d84ba1-f677-4870-b286-9e51fe80943d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:43.826559 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-24d84ba1-f677-4870-b286-9e51fe80943d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:44.097468 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-086ab572-2e8c-48d0-b0a9-c2fbc119ca91 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:44.099780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-086ab572-2e8c-48d0-b0a9-c2fbc119ca91 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:44.106814 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-086ab572-2e8c-48d0-b0a9-c2fbc119ca91 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:44.108669 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-086ab572-2e8c-48d0-b0a9-c2fbc119ca91 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:44.110880 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-086ab572-2e8c-48d0-b0a9-c2fbc119ca91 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:44.111689 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-086ab572-2e8c-48d0-b0a9-c2fbc119ca91 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:44.123034 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-24d84ba1-f677-4870-b286-9e51fe80943d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:44.132431 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-24d84ba1-f677-4870-b286-9e51fe80943d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.320518 Jul 07 07:22:44.149112 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 149/287] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:43 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:44.282498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e50a46b5-1bba-4d53-9e89-93a1fd12cc0b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:44.283632 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e50a46b5-1bba-4d53-9e89-93a1fd12cc0b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:44.290998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e50a46b5-1bba-4d53-9e89-93a1fd12cc0b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:44.291914 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e50a46b5-1bba-4d53-9e89-93a1fd12cc0b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:44.293032 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e50a46b5-1bba-4d53-9e89-93a1fd12cc0b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:44.293637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e50a46b5-1bba-4d53-9e89-93a1fd12cc0b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:44.399770 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-086ab572-2e8c-48d0-b0a9-c2fbc119ca91 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:44.419215 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-086ab572-2e8c-48d0-b0a9-c2fbc119ca91 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1367 microversion: 2.1 time: 0.327552 Jul 07 07:22:44.420866 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 139/288] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:44 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:44.529624 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e50a46b5-1bba-4d53-9e89-93a1fd12cc0b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:44.541370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e50a46b5-1bba-4d53-9e89-93a1fd12cc0b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:44.544023 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e50a46b5-1bba-4d53-9e89-93a1fd12cc0b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:44.545341 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e50a46b5-1bba-4d53-9e89-93a1fd12cc0b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.266989 Jul 07 07:22:44.556950 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 150/289] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:44 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:45.156648 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3d6c57c1-9cd3-47a0-a17c-3aaed609703d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:45.158087 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3d6c57c1-9cd3-47a0-a17c-3aaed609703d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:45.166797 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d6c57c1-9cd3-47a0-a17c-3aaed609703d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:45.167415 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d6c57c1-9cd3-47a0-a17c-3aaed609703d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:45.168501 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d6c57c1-9cd3-47a0-a17c-3aaed609703d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:45.169092 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d6c57c1-9cd3-47a0-a17c-3aaed609703d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:45.330624 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3d6c57c1-9cd3-47a0-a17c-3aaed609703d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:45.339512 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3d6c57c1-9cd3-47a0-a17c-3aaed609703d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.187261 Jul 07 07:22:45.341621 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 140/290] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:45 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:45.438551 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-16144159-0975-4f64-8492-7b6f41232c15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:45.439166 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-16144159-0975-4f64-8492-7b6f41232c15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:45.450763 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16144159-0975-4f64-8492-7b6f41232c15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:45.451212 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16144159-0975-4f64-8492-7b6f41232c15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:45.452003 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16144159-0975-4f64-8492-7b6f41232c15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:45.452416 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-16144159-0975-4f64-8492-7b6f41232c15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:45.473708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:45.577002 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-952ced22-0f64-4ce3-b020-6153c2cdb012 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:45.577824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-952ced22-0f64-4ce3-b020-6153c2cdb012 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:45.588527 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-952ced22-0f64-4ce3-b020-6153c2cdb012 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:45.589120 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-952ced22-0f64-4ce3-b020-6153c2cdb012 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:45.590329 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-952ced22-0f64-4ce3-b020-6153c2cdb012 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:45.592195 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-952ced22-0f64-4ce3-b020-6153c2cdb012 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:45.608690 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-16144159-0975-4f64-8492-7b6f41232c15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:45.616354 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-16144159-0975-4f64-8492-7b6f41232c15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1367 microversion: 2.1 time: 0.182386 Jul 07 07:22:45.617011 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 151/291] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:45 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:45.780561 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-952ced22-0f64-4ce3-b020-6153c2cdb012 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:45.790291 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-952ced22-0f64-4ce3-b020-6153c2cdb012 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:45.792387 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-952ced22-0f64-4ce3-b020-6153c2cdb012 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:45.793562 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-952ced22-0f64-4ce3-b020-6153c2cdb012 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.222143 Jul 07 07:22:45.794125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 141/292] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:45 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:46.359624 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-42587edd-2993-43f5-8111-2c705fe0307d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:46.362309 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-42587edd-2993-43f5-8111-2c705fe0307d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:46.372903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42587edd-2993-43f5-8111-2c705fe0307d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:46.374221 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42587edd-2993-43f5-8111-2c705fe0307d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:46.375146 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42587edd-2993-43f5-8111-2c705fe0307d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:46.375903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-42587edd-2993-43f5-8111-2c705fe0307d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:46.422452 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-c1ce22b5-f3ed-460c-8e09-c878d4278d9e req-b357ab79-3f52-451e-9235-7825c1d9256d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e7489d-0481-4cfe-8e7d-4d9bd447f492", "name": "network-vif-plugged", "status": "completed", "tag": "2adf9380-5032-4847-a6c2-7a57d1b430dd"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:46.433419 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-c1ce22b5-f3ed-460c-8e09-c878d4278d9e req-b357ab79-3f52-451e-9235-7825c1d9256d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:46.433756 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-c1ce22b5-f3ed-460c-8e09-c878d4278d9e req-b357ab79-3f52-451e-9235-7825c1d9256d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:46.454335 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-c1ce22b5-f3ed-460c-8e09-c878d4278d9e req-b357ab79-3f52-451e-9235-7825c1d9256d service nova] Creating event network-vif-plugged:2adf9380-5032-4847-a6c2-7a57d1b430dd for instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 on hv-cinder-82660 Jul 07 07:22:46.468853 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-c1ce22b5-f3ed-460c-8e09-c878d4278d9e req-b357ab79-3f52-451e-9235-7825c1d9256d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049981 Jul 07 07:22:46.472016 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 142/293] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:22:46.584490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-42587edd-2993-43f5-8111-2c705fe0307d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:46.593248 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-42587edd-2993-43f5-8111-2c705fe0307d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.238540 Jul 07 07:22:46.594024 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 152/294] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:46 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:46.635063 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e1722e8f-4099-4c06-a4c8-24958226d462 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:46.636302 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e1722e8f-4099-4c06-a4c8-24958226d462 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:46.647042 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e1722e8f-4099-4c06-a4c8-24958226d462 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:46.647753 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e1722e8f-4099-4c06-a4c8-24958226d462 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:46.654585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e1722e8f-4099-4c06-a4c8-24958226d462 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:46.654585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e1722e8f-4099-4c06-a4c8-24958226d462 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:46.812833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f17d2a5b-c081-40a1-bda7-8d33079a4be7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:46.813479 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f17d2a5b-c081-40a1-bda7-8d33079a4be7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:46.820583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f17d2a5b-c081-40a1-bda7-8d33079a4be7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:46.822486 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f17d2a5b-c081-40a1-bda7-8d33079a4be7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:46.823499 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f17d2a5b-c081-40a1-bda7-8d33079a4be7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:46.823938 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f17d2a5b-c081-40a1-bda7-8d33079a4be7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:46.877754 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e1722e8f-4099-4c06-a4c8-24958226d462 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:46.886066 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e1722e8f-4099-4c06-a4c8-24958226d462 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1367 microversion: 2.1 time: 0.256242 Jul 07 07:22:46.886661 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 143/295] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:46 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:46.985202 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f17d2a5b-c081-40a1-bda7-8d33079a4be7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:47.000220 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f17d2a5b-c081-40a1-bda7-8d33079a4be7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:47.002045 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f17d2a5b-c081-40a1-bda7-8d33079a4be7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:47.003516 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f17d2a5b-c081-40a1-bda7-8d33079a4be7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.195244 Jul 07 07:22:47.004592 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 153/296] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:46 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:22:47.610562 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7676b206-5487-49dc-b735-3e48e72dfe81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:47.611340 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7676b206-5487-49dc-b735-3e48e72dfe81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:47.617555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7676b206-5487-49dc-b735-3e48e72dfe81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:47.618532 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7676b206-5487-49dc-b735-3e48e72dfe81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:47.622023 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7676b206-5487-49dc-b735-3e48e72dfe81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:47.622644 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7676b206-5487-49dc-b735-3e48e72dfe81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:47.864851 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7676b206-5487-49dc-b735-3e48e72dfe81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:47.876070 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7676b206-5487-49dc-b735-3e48e72dfe81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.269390 Jul 07 07:22:47.887443 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 144/297] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:47 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:47.911813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9f2999a4-4493-4716-b7b0-d382df829039 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:47.912435 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9f2999a4-4493-4716-b7b0-d382df829039 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:47.923582 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f2999a4-4493-4716-b7b0-d382df829039 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:47.924059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f2999a4-4493-4716-b7b0-d382df829039 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:47.931861 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f2999a4-4493-4716-b7b0-d382df829039 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:47.932736 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f2999a4-4493-4716-b7b0-d382df829039 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:48.023938 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9c94c965-4217-48c0-8692-3eb9ae252b6b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:48.024438 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9c94c965-4217-48c0-8692-3eb9ae252b6b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:48.039698 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c94c965-4217-48c0-8692-3eb9ae252b6b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:48.040197 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c94c965-4217-48c0-8692-3eb9ae252b6b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:48.041052 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c94c965-4217-48c0-8692-3eb9ae252b6b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:48.052423 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c94c965-4217-48c0-8692-3eb9ae252b6b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:48.710824 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9f2999a4-4493-4716-b7b0-d382df829039 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:48.725241 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9f2999a4-4493-4716-b7b0-d382df829039 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1367 microversion: 2.1 time: 0.821215 Jul 07 07:22:48.726197 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 154/298] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:47 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1367 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:48.749733 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9c94c965-4217-48c0-8692-3eb9ae252b6b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:48.759908 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9c94c965-4217-48c0-8692-3eb9ae252b6b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:48.761829 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9c94c965-4217-48c0-8692-3eb9ae252b6b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:48.763048 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9c94c965-4217-48c0-8692-3eb9ae252b6b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.743962 Jul 07 07:22:48.774942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 145/299] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:48 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:48.893383 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-da06c962-d41d-4a62-8960-5a8700af8207 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:48.893998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-da06c962-d41d-4a62-8960-5a8700af8207 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:48.900773 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da06c962-d41d-4a62-8960-5a8700af8207 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:48.901211 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da06c962-d41d-4a62-8960-5a8700af8207 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:48.907412 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da06c962-d41d-4a62-8960-5a8700af8207 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:48.907855 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da06c962-d41d-4a62-8960-5a8700af8207 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:49.472875 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da06c962-d41d-4a62-8960-5a8700af8207 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:49.483698 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-da06c962-d41d-4a62-8960-5a8700af8207 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.594391 Jul 07 07:22:49.492513 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 155/300] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:48 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:49.767484 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ab4554fa-cd6a-4422-a633-5dbfa4404c8b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:49.768164 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ab4554fa-cd6a-4422-a633-5dbfa4404c8b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:49.787763 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cbda972b-064b-45b7-8e2a-2fc1f4db686b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:49.788748 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cbda972b-064b-45b7-8e2a-2fc1f4db686b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:49.806065 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbda972b-064b-45b7-8e2a-2fc1f4db686b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:49.806511 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab4554fa-cd6a-4422-a633-5dbfa4404c8b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:49.807174 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbda972b-064b-45b7-8e2a-2fc1f4db686b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:49.807848 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab4554fa-cd6a-4422-a633-5dbfa4404c8b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:49.810226 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbda972b-064b-45b7-8e2a-2fc1f4db686b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:49.810610 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab4554fa-cd6a-4422-a633-5dbfa4404c8b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:49.812051 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ab4554fa-cd6a-4422-a633-5dbfa4404c8b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:49.812392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbda972b-064b-45b7-8e2a-2fc1f4db686b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:50.179046 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ab4554fa-cd6a-4422-a633-5dbfa4404c8b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:50.191583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ab4554fa-cd6a-4422-a633-5dbfa4404c8b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1557 microversion: 2.1 time: 0.435328 Jul 07 07:22:50.195445 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 146/301] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:49 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1557 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:50.219993 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-747f82cc-d536-48d8-b348-a87f63c8dc28 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:50.221014 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-747f82cc-d536-48d8-b348-a87f63c8dc28 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:50.238740 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-747f82cc-d536-48d8-b348-a87f63c8dc28 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:50.239377 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-747f82cc-d536-48d8-b348-a87f63c8dc28 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:50.240436 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-747f82cc-d536-48d8-b348-a87f63c8dc28 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:50.242217 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-747f82cc-d536-48d8-b348-a87f63c8dc28 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:50.267764 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cbda972b-064b-45b7-8e2a-2fc1f4db686b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:50.278863 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cbda972b-064b-45b7-8e2a-2fc1f4db686b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:50.280713 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cbda972b-064b-45b7-8e2a-2fc1f4db686b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:50.296336 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cbda972b-064b-45b7-8e2a-2fc1f4db686b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1742 microversion: 2.20 time: 0.513434 Jul 07 07:22:50.310030 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 156/302] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:49 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1742 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:50.384050 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-747f82cc-d536-48d8-b348-a87f63c8dc28 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169085 Jul 07 07:22:50.387292 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 147/303] 10.222.0.62 () {58 vars in 1274 bytes} [Thu Jul 7 07:22:50 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:22:50.509178 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e275a512-4b68-4a4b-ae2e-385d54f631f6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:50.510010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e275a512-4b68-4a4b-ae2e-385d54f631f6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:50.526148 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e275a512-4b68-4a4b-ae2e-385d54f631f6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:50.526603 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e275a512-4b68-4a4b-ae2e-385d54f631f6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:50.529773 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e275a512-4b68-4a4b-ae2e-385d54f631f6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:50.530424 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e275a512-4b68-4a4b-ae2e-385d54f631f6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:50.993048 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e275a512-4b68-4a4b-ae2e-385d54f631f6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:51.007143 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e275a512-4b68-4a4b-ae2e-385d54f631f6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.501375 Jul 07 07:22:51.018986 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 157/304] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:50 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:51.323367 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7ae5a76e-1f36-42ca-a263-f3ea51e1cd93 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:51.325152 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7ae5a76e-1f36-42ca-a263-f3ea51e1cd93 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:51.339428 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ae5a76e-1f36-42ca-a263-f3ea51e1cd93 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:51.340197 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ae5a76e-1f36-42ca-a263-f3ea51e1cd93 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:51.341494 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ae5a76e-1f36-42ca-a263-f3ea51e1cd93 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:51.343065 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7ae5a76e-1f36-42ca-a263-f3ea51e1cd93 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:51.994855 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7ae5a76e-1f36-42ca-a263-f3ea51e1cd93 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:52.005652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7ae5a76e-1f36-42ca-a263-f3ea51e1cd93 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:52.007404 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7ae5a76e-1f36-42ca-a263-f3ea51e1cd93 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:52.008748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7ae5a76e-1f36-42ca-a263-f3ea51e1cd93 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1742 microversion: 2.20 time: 0.690549 Jul 07 07:22:52.010217 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 148/305] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:51 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1742 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:52.024519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-776500c8-c0f9-4621-b48d-6a35a7e29294 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:52.025318 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-776500c8-c0f9-4621-b48d-6a35a7e29294 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:52.052966 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-776500c8-c0f9-4621-b48d-6a35a7e29294 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:52.053697 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-776500c8-c0f9-4621-b48d-6a35a7e29294 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:52.054675 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-776500c8-c0f9-4621-b48d-6a35a7e29294 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:52.055260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-776500c8-c0f9-4621-b48d-6a35a7e29294 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:52.305610 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-776500c8-c0f9-4621-b48d-6a35a7e29294 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:52.325506 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-776500c8-c0f9-4621-b48d-6a35a7e29294 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.304736 Jul 07 07:22:52.326833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 158/306] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:52 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:52.590562 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-0b17c1ea-be30-4d84-8b3b-fd94e4e58bfd req-7fc8588f-dade-4b93-bdf2-eeca9ab3b384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8e7489d-0481-4cfe-8e7d-4d9bd447f492", "tag": "2adf9380-5032-4847-a6c2-7a57d1b430dd"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:52.601704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-0b17c1ea-be30-4d84-8b3b-fd94e4e58bfd req-7fc8588f-dade-4b93-bdf2-eeca9ab3b384 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:52.602395 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-0b17c1ea-be30-4d84-8b3b-fd94e4e58bfd req-7fc8588f-dade-4b93-bdf2-eeca9ab3b384 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:52.617565 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-0b17c1ea-be30-4d84-8b3b-fd94e4e58bfd req-7fc8588f-dade-4b93-bdf2-eeca9ab3b384 service nova] Creating event network-changed:2adf9380-5032-4847-a6c2-7a57d1b430dd for instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 on hv-cinder-82660 Jul 07 07:22:52.623878 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-0b17c1ea-be30-4d84-8b3b-fd94e4e58bfd req-7fc8588f-dade-4b93-bdf2-eeca9ab3b384 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037581 Jul 07 07:22:52.628739 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 149/307] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:22:52.982306 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-755547b8-add6-4bf3-8120-bc5e98f998cd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Action: 'create', calling method: .version_select at 0x7fccfa24be50>, body: {"keypair": {"name": "tempest-TestShelveInstance-945349269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxKO7aIDAwDo9nIvLm9/Ck/bDE2LD87IIklwW0PKUp+CELfhjwhHvy5j4Qp4iaxARwLi6m/JX9OS4IOIA6K0D/ZE6UjVaEW4BsPH0YioWeg8WUpHw1NRMIyZkyVoXVNSw=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:53.007202 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-755547b8-add6-4bf3-8120-bc5e98f998cd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Getting quotas for project 9ee25b35791243e698a41375cca91cea. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:22:53.013815 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-755547b8-add6-4bf3-8120-bc5e98f998cd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Getting quotas for user e1f0d73f1807487ca3eb016660b29f47 and project 9ee25b35791243e698a41375cca91cea. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:22:53.017333 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-42becf14-d1d8-4e14-9677-bed6f6358a63 req-0221aaf6-2f75-48bd-b42c-7803709db4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c", "name": "network-vif-plugged", "status": "completed", "tag": "7d78694f-a735-488f-84c8-ca44f4d7aba7"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:53.030757 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-42becf14-d1d8-4e14-9677-bed6f6358a63 req-0221aaf6-2f75-48bd-b42c-7803709db4b8 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.032741 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-42becf14-d1d8-4e14-9677-bed6f6358a63 req-0221aaf6-2f75-48bd-b42c-7803709db4b8 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.046699 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-755547b8-add6-4bf3-8120-bc5e98f998cd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.334772 Jul 07 07:22:53.048584 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 159/308] 10.222.0.62 () {60 vars in 1158 bytes} [Thu Jul 7 07:22:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:22:53.057452 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-42becf14-d1d8-4e14-9677-bed6f6358a63 req-0221aaf6-2f75-48bd-b42c-7803709db4b8 service nova] Creating event network-vif-plugged:7d78694f-a735-488f-84c8-ca44f4d7aba7 for instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c on hv-cinder-82660 Jul 07 07:22:53.067505 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-42becf14-d1d8-4e14-9677-bed6f6358a63 req-0221aaf6-2f75-48bd-b42c-7803709db4b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055224 Jul 07 07:22:53.068865 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 150/309] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:22:53.073885 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c26f894d-e00d-458e-8979-96636d051a1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:53.074709 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c26f894d-e00d-458e-8979-96636d051a1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:53.084975 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c26f894d-e00d-458e-8979-96636d051a1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.086126 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c26f894d-e00d-458e-8979-96636d051a1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.087391 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c26f894d-e00d-458e-8979-96636d051a1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.087860 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c26f894d-e00d-458e-8979-96636d051a1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.317057 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c26f894d-e00d-458e-8979-96636d051a1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:53.344685 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4bffd2dc-7f3e-4b51-b072-fccb299c3930 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:53.346711 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c26f894d-e00d-458e-8979-96636d051a1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:53.347047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4bffd2dc-7f3e-4b51-b072-fccb299c3930 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:53.352960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c26f894d-e00d-458e-8979-96636d051a1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:53.355921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4bffd2dc-7f3e-4b51-b072-fccb299c3930 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.356083 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c26f894d-e00d-458e-8979-96636d051a1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1742 microversion: 2.20 time: 0.304456 Jul 07 07:22:53.356746 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4bffd2dc-7f3e-4b51-b072-fccb299c3930 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.358001 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4bffd2dc-7f3e-4b51-b072-fccb299c3930 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.358694 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4bffd2dc-7f3e-4b51-b072-fccb299c3930 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.361708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 160/310] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:53 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1742 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:53.538107 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4bffd2dc-7f3e-4b51-b072-fccb299c3930 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:53.546941 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4bffd2dc-7f3e-4b51-b072-fccb299c3930 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1502 microversion: 2.1 time: 0.207642 Jul 07 07:22:53.547673 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 151/311] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:53 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:22:53.565294 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cd76a7a2-2203-49b3-9612-a7e56f7b3669 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "498bf2bd-b398-4620-bf7a-975951aadf8f"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:53.566414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cd76a7a2-2203-49b3-9612-a7e56f7b3669 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:53.574473 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd76a7a2-2203-49b3-9612-a7e56f7b3669 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.574935 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd76a7a2-2203-49b3-9612-a7e56f7b3669 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.575733 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd76a7a2-2203-49b3-9612-a7e56f7b3669 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.576170 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd76a7a2-2203-49b3-9612-a7e56f7b3669 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.607140 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-cd76a7a2-2203-49b3-9612-a7e56f7b3669 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] HTTP exception thrown: Cannot 'attach_volume' instance f3f038b4-3e52-4a94-833f-708642a6fe10 while it is in vm_state rescued Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cd76a7a2-2203-49b3-9612-a7e56f7b3669 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Request method failure captured: Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: POST /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10/os-volume_attachments HTTP/1.1 Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 74 Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixomBgYKq99kztrIf-WXBT-oxXPLtswlcfUwVT_4CumoXbRkjjrZnfPLDoVDrFcuZtG6MmBwoFMiMVriYFP69L1sx8H6oqVwqo5FsA2CCk7qzym3IjG9WkQtWXfpG23zk0wtp5Enbd45xiS0O04WrCwexa1Gjm6jabSe4F855x7F4yTU Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 441079c8bc1b4a4fb8f38fff6728f3ef Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:22:53.610215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 441079c8bc1b4a4fb8f38fff6728f3ef Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-ServerRescueNegativeTestJSON-1796603694-project Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: b80ab2a9c7504806851400e07074004e Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796603694-project Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {"volumeAttachment": {"volumeId": "498bf2bd-b398-4620-bf7a-975951aadf8f"}} Jul 07 07:22:53.611792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Cannot 'attach_volume' instance f3f038b4-3e52-4a94-833f-708642a6fe10 while it is in vm_state rescued Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'server_id': 'f3f038b4-3e52-4a94-833f-708642a6fe10', 'body': {'volumeAttachment': {'volumeId': '498bf2bd-b398-4620-bf7a-975951aadf8f'}}} Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f3f038b4-3e52-4a94-833f-708642a6fe10 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:22:53.616105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f3f038b4-3e52-4a94-833f-708642a6fe10 while it is in vm_state rescued Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:22:53.617637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:22:53.619001 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:22:53.619001 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:22:53.619001 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f3f038b4-3e52-4a94-833f-708642a6fe10 while it is in vm_state rescued Jul 07 07:22:53.619001 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:22:53.619001 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cd76a7a2-2203-49b3-9612-a7e56f7b3669 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Returning 409 to user: Cannot 'attach_volume' instance f3f038b4-3e52-4a94-833f-708642a6fe10 while it is in vm_state rescued {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:22:53.619001 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cd76a7a2-2203-49b3-9612-a7e56f7b3669 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051313 Jul 07 07:22:53.619001 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 161/312] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:22:53 2022] POST /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 07 07:22:53.620957 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f4eeba59-2a8e-43f4-bbee-fa642603a677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:22:53.630319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f4eeba59-2a8e-43f4-bbee-fa642603a677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:53.645332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4eeba59-2a8e-43f4-bbee-fa642603a677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.645792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4eeba59-2a8e-43f4-bbee-fa642603a677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.646728 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4eeba59-2a8e-43f4-bbee-fa642603a677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.647068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f4eeba59-2a8e-43f4-bbee-fa642603a677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.679761 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:22:53.755634 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f4eeba59-2a8e-43f4-bbee-fa642603a677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10/action" status: 202 len: 0 microversion: 2.1 time: 0.138345 Jul 07 07:22:53.756550 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 152/313] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:22:53 2022] POST /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:22:53.765140 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6b268dcc-5d5b-4b01-89ca-2b93622a976b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:53.765727 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6b268dcc-5d5b-4b01-89ca-2b93622a976b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:53.772299 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b268dcc-5d5b-4b01-89ca-2b93622a976b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.772751 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b268dcc-5d5b-4b01-89ca-2b93622a976b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.773608 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b268dcc-5d5b-4b01-89ca-2b93622a976b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:53.774164 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b268dcc-5d5b-4b01-89ca-2b93622a976b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:53.983177 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6b268dcc-5d5b-4b01-89ca-2b93622a976b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:53.999393 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6b268dcc-5d5b-4b01-89ca-2b93622a976b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1510 microversion: 2.1 time: 0.237693 Jul 07 07:22:54.000559 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 162/314] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:53 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:54.375843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f892978e-4448-4848-a1ad-f571f2e9076d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:54.376619 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f892978e-4448-4848-a1ad-f571f2e9076d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:54.384157 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f892978e-4448-4848-a1ad-f571f2e9076d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:54.384535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f892978e-4448-4848-a1ad-f571f2e9076d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:54.385415 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f892978e-4448-4848-a1ad-f571f2e9076d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:54.385873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f892978e-4448-4848-a1ad-f571f2e9076d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:54.553769 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f892978e-4448-4848-a1ad-f571f2e9076d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:54.563010 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f892978e-4448-4848-a1ad-f571f2e9076d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:54.564615 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f892978e-4448-4848-a1ad-f571f2e9076d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:54.566111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f892978e-4448-4848-a1ad-f571f2e9076d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1742 microversion: 2.20 time: 0.195126 Jul 07 07:22:54.567041 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 153/315] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:54 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:55.017772 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0eae28c6-c25c-474d-b7f5-80cf535d7743 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:55.018491 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0eae28c6-c25c-474d-b7f5-80cf535d7743 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:55.025726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0eae28c6-c25c-474d-b7f5-80cf535d7743 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:55.026238 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0eae28c6-c25c-474d-b7f5-80cf535d7743 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:55.027061 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0eae28c6-c25c-474d-b7f5-80cf535d7743 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:55.027549 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0eae28c6-c25c-474d-b7f5-80cf535d7743 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:55.175263 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0eae28c6-c25c-474d-b7f5-80cf535d7743 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:55.183159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0eae28c6-c25c-474d-b7f5-80cf535d7743 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1510 microversion: 2.1 time: 0.169344 Jul 07 07:22:55.183706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 163/316] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:55 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:55.586924 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e51758ed-be8a-439d-841c-44bc526adcf0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:55.587658 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e51758ed-be8a-439d-841c-44bc526adcf0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:55.596108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e51758ed-be8a-439d-841c-44bc526adcf0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:55.596679 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e51758ed-be8a-439d-841c-44bc526adcf0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:55.597688 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e51758ed-be8a-439d-841c-44bc526adcf0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:55.598234 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e51758ed-be8a-439d-841c-44bc526adcf0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:55.739107 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e51758ed-be8a-439d-841c-44bc526adcf0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:55.748001 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e51758ed-be8a-439d-841c-44bc526adcf0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:55.749616 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e51758ed-be8a-439d-841c-44bc526adcf0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:55.750984 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e51758ed-be8a-439d-841c-44bc526adcf0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1742 microversion: 2.20 time: 0.169219 Jul 07 07:22:55.751541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 154/317] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:55 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1742 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:56.207003 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bfbdbc12-ca7d-40b8-a427-784894f8f9a6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:56.208914 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bfbdbc12-ca7d-40b8-a427-784894f8f9a6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:56.233712 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfbdbc12-ca7d-40b8-a427-784894f8f9a6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:56.235435 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfbdbc12-ca7d-40b8-a427-784894f8f9a6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:56.239860 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfbdbc12-ca7d-40b8-a427-784894f8f9a6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:56.240650 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-bfbdbc12-ca7d-40b8-a427-784894f8f9a6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:56.560851 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bfbdbc12-ca7d-40b8-a427-784894f8f9a6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:56.584243 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bfbdbc12-ca7d-40b8-a427-784894f8f9a6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1510 microversion: 2.1 time: 0.386843 Jul 07 07:22:56.585983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 164/318] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:56 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1510 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:56.772245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ef3d9571-4ea5-4b3a-9a4c-ed7ba4d14dc2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:56.772893 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ef3d9571-4ea5-4b3a-9a4c-ed7ba4d14dc2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:56.780365 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef3d9571-4ea5-4b3a-9a4c-ed7ba4d14dc2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:56.780821 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef3d9571-4ea5-4b3a-9a4c-ed7ba4d14dc2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:56.781686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef3d9571-4ea5-4b3a-9a4c-ed7ba4d14dc2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:56.782127 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef3d9571-4ea5-4b3a-9a4c-ed7ba4d14dc2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:57.052018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ef3d9571-4ea5-4b3a-9a4c-ed7ba4d14dc2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:57.062176 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ef3d9571-4ea5-4b3a-9a4c-ed7ba4d14dc2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:57.064123 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ef3d9571-4ea5-4b3a-9a4c-ed7ba4d14dc2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:57.065933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ef3d9571-4ea5-4b3a-9a4c-ed7ba4d14dc2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1737 microversion: 2.20 time: 0.299958 Jul 07 07:22:57.066539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 155/319] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:56 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1737 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:57.631356 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a0f15b62-c380-471c-bef6-6c5e14c4decd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:57.633888 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a0f15b62-c380-471c-bef6-6c5e14c4decd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:57.645042 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0f15b62-c380-471c-bef6-6c5e14c4decd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:57.645617 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0f15b62-c380-471c-bef6-6c5e14c4decd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:57.647527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0f15b62-c380-471c-bef6-6c5e14c4decd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:57.648087 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0f15b62-c380-471c-bef6-6c5e14c4decd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:57.918865 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a0f15b62-c380-471c-bef6-6c5e14c4decd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:57.929986 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a0f15b62-c380-471c-bef6-6c5e14c4decd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1510 microversion: 2.1 time: 0.322638 Jul 07 07:22:57.940735 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 165/320] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:57 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1510 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:58.094764 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7bacc1a6-48bf-4e59-bbf1-11328ad8c476 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:58.096502 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7bacc1a6-48bf-4e59-bbf1-11328ad8c476 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:58.114346 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bacc1a6-48bf-4e59-bbf1-11328ad8c476 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:58.115180 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bacc1a6-48bf-4e59-bbf1-11328ad8c476 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:58.116934 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bacc1a6-48bf-4e59-bbf1-11328ad8c476 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:58.118345 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7bacc1a6-48bf-4e59-bbf1-11328ad8c476 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:58.318069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7bacc1a6-48bf-4e59-bbf1-11328ad8c476 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:58.330336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7bacc1a6-48bf-4e59-bbf1-11328ad8c476 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:58.331987 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7bacc1a6-48bf-4e59-bbf1-11328ad8c476 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:58.333296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7bacc1a6-48bf-4e59-bbf1-11328ad8c476 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1737 microversion: 2.20 time: 0.252194 Jul 07 07:22:58.334304 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 156/321] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:58 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:22:58.953446 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-355f643e-8615-4007-adce-b2a7a5336961 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:58.954872 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-355f643e-8615-4007-adce-b2a7a5336961 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:58.967819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-355f643e-8615-4007-adce-b2a7a5336961 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:58.995000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-355f643e-8615-4007-adce-b2a7a5336961 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:58.996226 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-355f643e-8615-4007-adce-b2a7a5336961 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:58.997718 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-355f643e-8615-4007-adce-b2a7a5336961 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:59.319502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-355f643e-8615-4007-adce-b2a7a5336961 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:59.331054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-355f643e-8615-4007-adce-b2a7a5336961 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1510 microversion: 2.1 time: 0.387148 Jul 07 07:22:59.332433 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 166/322] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:22:58 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1510 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:22:59.354683 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-61d94f63-c589-4309-b81b-f8199b3db84c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:22:59.356188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-61d94f63-c589-4309-b81b-f8199b3db84c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:22:59.366784 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61d94f63-c589-4309-b81b-f8199b3db84c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:59.367521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61d94f63-c589-4309-b81b-f8199b3db84c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:59.368495 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61d94f63-c589-4309-b81b-f8199b3db84c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:22:59.369699 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-61d94f63-c589-4309-b81b-f8199b3db84c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:22:59.595963 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-61d94f63-c589-4309-b81b-f8199b3db84c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:59.605981 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-61d94f63-c589-4309-b81b-f8199b3db84c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:59.608010 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-61d94f63-c589-4309-b81b-f8199b3db84c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:22:59.609438 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-61d94f63-c589-4309-b81b-f8199b3db84c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1737 microversion: 2.20 time: 0.262422 Jul 07 07:22:59.610464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 157/323] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:22:59 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:00.350974 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eff943a8-e8bb-4cee-9fc3-0bc9a70baaa5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:00.351952 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eff943a8-e8bb-4cee-9fc3-0bc9a70baaa5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:00.365728 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eff943a8-e8bb-4cee-9fc3-0bc9a70baaa5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:00.366553 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eff943a8-e8bb-4cee-9fc3-0bc9a70baaa5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:00.372056 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eff943a8-e8bb-4cee-9fc3-0bc9a70baaa5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:00.372709 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eff943a8-e8bb-4cee-9fc3-0bc9a70baaa5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:00.572412 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eff943a8-e8bb-4cee-9fc3-0bc9a70baaa5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:00.584031 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eff943a8-e8bb-4cee-9fc3-0bc9a70baaa5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1510 microversion: 2.1 time: 0.237959 Jul 07 07:23:00.585208 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 167/324] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:00 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:00.634541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4a90390e-996e-42a1-89ca-bcb713fe9b1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:00.642562 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4a90390e-996e-42a1-89ca-bcb713fe9b1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:00.659408 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a90390e-996e-42a1-89ca-bcb713fe9b1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:00.659857 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a90390e-996e-42a1-89ca-bcb713fe9b1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:00.660639 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a90390e-996e-42a1-89ca-bcb713fe9b1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:00.661073 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4a90390e-996e-42a1-89ca-bcb713fe9b1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:00.826952 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4a90390e-996e-42a1-89ca-bcb713fe9b1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:00.835865 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4a90390e-996e-42a1-89ca-bcb713fe9b1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:00.837900 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4a90390e-996e-42a1-89ca-bcb713fe9b1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:00.839224 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4a90390e-996e-42a1-89ca-bcb713fe9b1b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1737 microversion: 2.20 time: 0.214025 Jul 07 07:23:00.845485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 158/325] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:00 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:01.602479 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b34b7bed-3936-4f73-ab22-19ebcbfa2ded tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:01.603771 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b34b7bed-3936-4f73-ab22-19ebcbfa2ded tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:01.611541 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b34b7bed-3936-4f73-ab22-19ebcbfa2ded tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:01.612281 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b34b7bed-3936-4f73-ab22-19ebcbfa2ded tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:01.613406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b34b7bed-3936-4f73-ab22-19ebcbfa2ded tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:01.614105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b34b7bed-3936-4f73-ab22-19ebcbfa2ded tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:01.825875 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b34b7bed-3936-4f73-ab22-19ebcbfa2ded tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:01.835259 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b34b7bed-3936-4f73-ab22-19ebcbfa2ded tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1510 microversion: 2.1 time: 0.237091 Jul 07 07:23:01.846672 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 168/326] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:01 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:01.859269 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e9c5f133-0bc3-49ed-9583-d0fa8c5db46d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:01.860682 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e9c5f133-0bc3-49ed-9583-d0fa8c5db46d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:01.863200 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=79 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:01.870985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c5f133-0bc3-49ed-9583-d0fa8c5db46d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:01.871811 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c5f133-0bc3-49ed-9583-d0fa8c5db46d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:01.872849 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c5f133-0bc3-49ed-9583-d0fa8c5db46d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:01.873543 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9c5f133-0bc3-49ed-9583-d0fa8c5db46d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:02.065540 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e9c5f133-0bc3-49ed-9583-d0fa8c5db46d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:02.081106 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e9c5f133-0bc3-49ed-9583-d0fa8c5db46d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:02.082681 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e9c5f133-0bc3-49ed-9583-d0fa8c5db46d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:02.084290 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e9c5f133-0bc3-49ed-9583-d0fa8c5db46d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1737 microversion: 2.20 time: 0.229150 Jul 07 07:23:02.084848 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 159/327] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:01 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:02.854785 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a44ed6ee-39b1-4bda-abb5-e94dcd6a0b44 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:02.855409 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a44ed6ee-39b1-4bda-abb5-e94dcd6a0b44 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:02.863352 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a44ed6ee-39b1-4bda-abb5-e94dcd6a0b44 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:02.863812 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a44ed6ee-39b1-4bda-abb5-e94dcd6a0b44 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:02.864627 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a44ed6ee-39b1-4bda-abb5-e94dcd6a0b44 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:02.865041 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a44ed6ee-39b1-4bda-abb5-e94dcd6a0b44 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:02.887176 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:03.026384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:03.053177 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a44ed6ee-39b1-4bda-abb5-e94dcd6a0b44 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:03.069972 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a44ed6ee-39b1-4bda-abb5-e94dcd6a0b44 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1510 microversion: 2.1 time: 0.219443 Jul 07 07:23:03.080076 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 169/328] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:02 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:03.104977 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c317e40f-cec1-48b2-a17f-6275a69a2534 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:03.105936 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c317e40f-cec1-48b2-a17f-6275a69a2534 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:03.113037 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c317e40f-cec1-48b2-a17f-6275a69a2534 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:03.113688 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c317e40f-cec1-48b2-a17f-6275a69a2534 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:03.114485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c317e40f-cec1-48b2-a17f-6275a69a2534 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:03.114918 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c317e40f-cec1-48b2-a17f-6275a69a2534 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:03.291310 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c317e40f-cec1-48b2-a17f-6275a69a2534 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:03.300931 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c317e40f-cec1-48b2-a17f-6275a69a2534 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:03.302718 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c317e40f-cec1-48b2-a17f-6275a69a2534 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:03.304257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c317e40f-cec1-48b2-a17f-6275a69a2534 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1737 microversion: 2.20 time: 0.204007 Jul 07 07:23:03.305018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 160/329] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:03 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:04.089331 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-198c02e2-2d0e-430a-99b9-1d1a61b79ff9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:04.090671 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-198c02e2-2d0e-430a-99b9-1d1a61b79ff9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:04.099045 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-198c02e2-2d0e-430a-99b9-1d1a61b79ff9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:04.099782 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-198c02e2-2d0e-430a-99b9-1d1a61b79ff9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:04.100871 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-198c02e2-2d0e-430a-99b9-1d1a61b79ff9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:04.101628 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-198c02e2-2d0e-430a-99b9-1d1a61b79ff9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:04.318397 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-198c02e2-2d0e-430a-99b9-1d1a61b79ff9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:04.328317 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-57f3b826-9e8c-4749-b469-1ab35a1a5b3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:04.330081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-57f3b826-9e8c-4749-b469-1ab35a1a5b3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:04.336824 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-198c02e2-2d0e-430a-99b9-1d1a61b79ff9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1510 microversion: 2.1 time: 0.251724 Jul 07 07:23:04.346655 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 170/330] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:04 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:04.346884 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57f3b826-9e8c-4749-b469-1ab35a1a5b3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:04.346884 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57f3b826-9e8c-4749-b469-1ab35a1a5b3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:04.346884 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57f3b826-9e8c-4749-b469-1ab35a1a5b3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:04.346884 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57f3b826-9e8c-4749-b469-1ab35a1a5b3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:04.515543 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-57f3b826-9e8c-4749-b469-1ab35a1a5b3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:04.526280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-57f3b826-9e8c-4749-b469-1ab35a1a5b3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:04.528153 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-57f3b826-9e8c-4749-b469-1ab35a1a5b3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:04.530177 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-57f3b826-9e8c-4749-b469-1ab35a1a5b3e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1737 microversion: 2.20 time: 0.205441 Jul 07 07:23:04.530838 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 161/331] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:04 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:23:05.358159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3c78d7f2-70db-42da-8d6f-e8bfc0d8cb8b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:05.359625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3c78d7f2-70db-42da-8d6f-e8bfc0d8cb8b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:05.367545 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c78d7f2-70db-42da-8d6f-e8bfc0d8cb8b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:05.368114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c78d7f2-70db-42da-8d6f-e8bfc0d8cb8b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:05.369000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c78d7f2-70db-42da-8d6f-e8bfc0d8cb8b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:05.369554 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3c78d7f2-70db-42da-8d6f-e8bfc0d8cb8b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:05.555652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-599caa15-5dc2-4b72-a24d-fda87508eded tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:05.557763 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-599caa15-5dc2-4b72-a24d-fda87508eded tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:05.568943 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-599caa15-5dc2-4b72-a24d-fda87508eded tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:05.569794 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-599caa15-5dc2-4b72-a24d-fda87508eded tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:05.571280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-599caa15-5dc2-4b72-a24d-fda87508eded tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:05.572189 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-599caa15-5dc2-4b72-a24d-fda87508eded tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:05.631460 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3c78d7f2-70db-42da-8d6f-e8bfc0d8cb8b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:05.648615 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3c78d7f2-70db-42da-8d6f-e8bfc0d8cb8b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1510 microversion: 2.1 time: 0.296883 Jul 07 07:23:05.649502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 171/332] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:05 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1510 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:05.797266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-599caa15-5dc2-4b72-a24d-fda87508eded tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:05.806867 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-599caa15-5dc2-4b72-a24d-fda87508eded tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:05.809297 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-599caa15-5dc2-4b72-a24d-fda87508eded tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:05.812415 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-599caa15-5dc2-4b72-a24d-fda87508eded tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1737 microversion: 2.20 time: 0.265516 Jul 07 07:23:05.813391 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 162/333] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:05 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1737 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:06.666600 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3f148671-d2e6-4ca1-a1d1-4e9959a75095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:06.667238 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3f148671-d2e6-4ca1-a1d1-4e9959a75095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:06.673414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f148671-d2e6-4ca1-a1d1-4e9959a75095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:06.673858 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f148671-d2e6-4ca1-a1d1-4e9959a75095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:06.674629 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f148671-d2e6-4ca1-a1d1-4e9959a75095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:06.675069 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3f148671-d2e6-4ca1-a1d1-4e9959a75095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:06.832746 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-388e1b92-1144-4c75-8f78-a279b681f0f1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:06.833169 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-388e1b92-1144-4c75-8f78-a279b681f0f1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:06.834777 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3f148671-d2e6-4ca1-a1d1-4e9959a75095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:06.839700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-388e1b92-1144-4c75-8f78-a279b681f0f1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:06.840363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-388e1b92-1144-4c75-8f78-a279b681f0f1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:06.841250 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-388e1b92-1144-4c75-8f78-a279b681f0f1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:06.841876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-388e1b92-1144-4c75-8f78-a279b681f0f1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:06.843227 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3f148671-d2e6-4ca1-a1d1-4e9959a75095 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1516 microversion: 2.1 time: 0.180589 Jul 07 07:23:06.844173 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 172/334] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:06 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:06.985576 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-388e1b92-1144-4c75-8f78-a279b681f0f1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:06.994018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-388e1b92-1144-4c75-8f78-a279b681f0f1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:06.995890 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-388e1b92-1144-4c75-8f78-a279b681f0f1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:06.997208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-388e1b92-1144-4c75-8f78-a279b681f0f1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1737 microversion: 2.20 time: 0.168675 Jul 07 07:23:06.997649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 163/335] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:06 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:08.022812 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-68f80d17-46fc-48d5-b190-5894f4f80a36 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:08.023953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-68f80d17-46fc-48d5-b190-5894f4f80a36 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:08.037401 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68f80d17-46fc-48d5-b190-5894f4f80a36 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:08.038705 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68f80d17-46fc-48d5-b190-5894f4f80a36 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:08.040085 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68f80d17-46fc-48d5-b190-5894f4f80a36 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:08.040892 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68f80d17-46fc-48d5-b190-5894f4f80a36 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:08.189494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-68f80d17-46fc-48d5-b190-5894f4f80a36 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:08.197260 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-77325fb7-d11b-4803-adb0-6e421efa9de7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'create', calling method: .version_select at 0x7fccfa31adc0>, body: {"keypair": {"name": "tempest-keypair-1323280214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnnAJw4aeyOwhMP/IcNbXSt5UGfdAv+8Phgg7ROw5nbk2YN4IF0/HB/qwAizYgJNvbjLs34lPk2m2esuJuSEEm+TTbzyqpCByZCEoTZYgLMU69ZjRoKRU8+veyBDWpqBQ=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:08.198397 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-68f80d17-46fc-48d5-b190-5894f4f80a36 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:08.199956 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-68f80d17-46fc-48d5-b190-5894f4f80a36 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:08.201149 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-68f80d17-46fc-48d5-b190-5894f4f80a36 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1719 microversion: 2.20 time: 0.187817 Jul 07 07:23:08.201761 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 173/336] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:08 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1719 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:08.213144 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-77325fb7-d11b-4803-adb0-6e421efa9de7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Getting quotas for project 441079c8bc1b4a4fb8f38fff6728f3ef. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:23:08.217613 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-77325fb7-d11b-4803-adb0-6e421efa9de7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Getting quotas for user b80ab2a9c7504806851400e07074004e and project 441079c8bc1b4a4fb8f38fff6728f3ef. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:23:08.240659 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-77325fb7-d11b-4803-adb0-6e421efa9de7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047319 Jul 07 07:23:08.241295 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 164/337] 10.222.0.62 () {60 vars in 1158 bytes} [Thu Jul 7 07:23:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:23:09.221325 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-638e6362-029e-4f36-b364-ef12ff15e173 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:09.221901 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-638e6362-029e-4f36-b364-ef12ff15e173 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:09.229237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-638e6362-029e-4f36-b364-ef12ff15e173 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:09.229708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-638e6362-029e-4f36-b364-ef12ff15e173 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:09.231876 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-638e6362-029e-4f36-b364-ef12ff15e173 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:09.232403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-638e6362-029e-4f36-b364-ef12ff15e173 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:09.431366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-638e6362-029e-4f36-b364-ef12ff15e173 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:09.440609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-638e6362-029e-4f36-b364-ef12ff15e173 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:09.442130 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-638e6362-029e-4f36-b364-ef12ff15e173 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:09.443299 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-638e6362-029e-4f36-b364-ef12ff15e173 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1719 microversion: 2.20 time: 0.226479 Jul 07 07:23:09.454904 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 174/338] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:09 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:09.778519 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1526959237", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "713aabcc-1616-4491-9707-c7efe5202fa0"}], "security_groups": [{"name": "tempest-securitygroup--1251096263"}], "key_name": "tempest-keypair-1323280214", "user_data": "}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:09.890591 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] validate_networks() for [('713aabcc-1616-4491-9707-c7efe5202fa0', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:23:10.463626 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-188707e7-59a3-4c78-850d-b4338df38278 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:10.464345 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-188707e7-59a3-4c78-850d-b4338df38278 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:10.468130 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:10.472256 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-188707e7-59a3-4c78-850d-b4338df38278 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:10.472836 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-188707e7-59a3-4c78-850d-b4338df38278 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:10.473934 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-188707e7-59a3-4c78-850d-b4338df38278 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:10.474472 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-188707e7-59a3-4c78-850d-b4338df38278 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:10.583966 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:23:10.584445 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:23:10.584923 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:23:10.585368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:23:10.585814 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:23:10.595958 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:10.596414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:10.597312 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:10.597818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:10.616335 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Getting quotas for project 441079c8bc1b4a4fb8f38fff6728f3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:23:10.621068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Getting quotas for user b80ab2a9c7504806851400e07074004e and project 441079c8bc1b4a4fb8f38fff6728f3ef. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:23:10.632133 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-188707e7-59a3-4c78-850d-b4338df38278 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:10.633932 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:23:10.636456 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:23:10.645926 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-188707e7-59a3-4c78-850d-b4338df38278 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:10.647566 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-188707e7-59a3-4c78-850d-b4338df38278 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:10.649241 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-188707e7-59a3-4c78-850d-b4338df38278 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1722 microversion: 2.20 time: 0.189664 Jul 07 07:23:10.649877 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 175/339] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:10 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:10.671976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b97a12f2-1185-4b30-b639-65d4bef2820e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "490c1f63-45f4-4efa-9cec-d32b97dc595e"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:10.673387 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b97a12f2-1185-4b30-b639-65d4bef2820e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:10.680165 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b97a12f2-1185-4b30-b639-65d4bef2820e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:10.680929 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b97a12f2-1185-4b30-b639-65d4bef2820e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:10.681753 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b97a12f2-1185-4b30-b639-65d4bef2820e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:10.682147 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b97a12f2-1185-4b30-b639-65d4bef2820e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:10.689312 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ed09a322-ea7b-4f01-a601-a9778a5a3f2a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.915179 Jul 07 07:23:10.689962 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 165/340] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:23:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 07 07:23:10.700162 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f08eba51-9b6b-43f0-b5d1-a7cf07a4f999 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:10.701062 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f08eba51-9b6b-43f0-b5d1-a7cf07a4f999 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:10.762798 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f08eba51-9b6b-43f0-b5d1-a7cf07a4f999 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:10.770541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f08eba51-9b6b-43f0-b5d1-a7cf07a4f999 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1246 microversion: 2.1 time: 0.074473 Jul 07 07:23:10.771440 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 166/341] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:10 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:10.987497 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-9d6e249d-c1db-41f6-875e-09a44e90eb94 req-b25644e5-bb6f-43a5-b14f-a6f5aada3bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c", "name": "network-vif-unplugged", "status": "completed", "tag": "7d78694f-a735-488f-84c8-ca44f4d7aba7"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:11.013709 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-9d6e249d-c1db-41f6-875e-09a44e90eb94 req-b25644e5-bb6f-43a5-b14f-a6f5aada3bc9 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:11.015700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-9d6e249d-c1db-41f6-875e-09a44e90eb94 req-b25644e5-bb6f-43a5-b14f-a6f5aada3bc9 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:11.046850 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.compute.server_external_events [req-9d6e249d-c1db-41f6-875e-09a44e90eb94 req-b25644e5-bb6f-43a5-b14f-a6f5aada3bc9 service nova] Unable to find a host for instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c. Dropping event network-vif-unplugged {{(pid=117788) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 07 07:23:11.047900 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-9d6e249d-c1db-41f6-875e-09a44e90eb94 req-b25644e5-bb6f-43a5-b14f-a6f5aada3bc9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.069722 Jul 07 07:23:11.048968 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 167/342] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 07 07:23:11.108933 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b97a12f2-1185-4b30-b639-65d4bef2820e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "POST /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.441320 Jul 07 07:23:11.110790 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 176/343] 10.222.0.62 () {62 vars in 1363 bytes} [Thu Jul 7 07:23:10 2022] POST /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments => generated 188 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:23:11.246008 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9687ec21-c57f-4bbf-881f-5951aa53e70d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:11.246587 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9687ec21-c57f-4bbf-881f-5951aa53e70d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:11.258071 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9687ec21-c57f-4bbf-881f-5951aa53e70d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:11.258071 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9687ec21-c57f-4bbf-881f-5951aa53e70d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:11.258749 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9687ec21-c57f-4bbf-881f-5951aa53e70d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:11.259370 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9687ec21-c57f-4bbf-881f-5951aa53e70d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:11.362885 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9687ec21-c57f-4bbf-881f-5951aa53e70d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "POST /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/action" status: 202 len: 0 microversion: 2.20 time: 0.125500 Jul 07 07:23:11.363726 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 168/344] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Jul 7 07:23:11 2022] POST /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:23:11.377170 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7dc75ff3-da02-44d6-bce3-d3af090e75b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:11.377808 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7dc75ff3-da02-44d6-bce3-d3af090e75b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:11.397036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dc75ff3-da02-44d6-bce3-d3af090e75b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:11.397778 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dc75ff3-da02-44d6-bce3-d3af090e75b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:11.398677 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dc75ff3-da02-44d6-bce3-d3af090e75b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:11.399096 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7dc75ff3-da02-44d6-bce3-d3af090e75b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:11.564181 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7dc75ff3-da02-44d6-bce3-d3af090e75b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:11.574332 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7dc75ff3-da02-44d6-bce3-d3af090e75b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:11.576526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7dc75ff3-da02-44d6-bce3-d3af090e75b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:11.578197 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7dc75ff3-da02-44d6-bce3-d3af090e75b9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1748 microversion: 2.20 time: 0.204826 Jul 07 07:23:11.590390 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 177/345] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:11 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1748 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:11.787797 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-260ffb57-5b5d-4318-8eb9-6642fca0c8d5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:11.788414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-260ffb57-5b5d-4318-8eb9-6642fca0c8d5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:11.795219 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-260ffb57-5b5d-4318-8eb9-6642fca0c8d5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:11.795789 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-260ffb57-5b5d-4318-8eb9-6642fca0c8d5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:11.796441 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-260ffb57-5b5d-4318-8eb9-6642fca0c8d5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:11.796887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-260ffb57-5b5d-4318-8eb9-6642fca0c8d5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:11.867551 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-260ffb57-5b5d-4318-8eb9-6642fca0c8d5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:11.875228 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-260ffb57-5b5d-4318-8eb9-6642fca0c8d5 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1298 microversion: 2.1 time: 0.091344 Jul 07 07:23:11.876184 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 169/346] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:11 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:12.599215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7a9d0f65-0318-4ed2-a08f-eb3ebc89955f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:12.600058 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7a9d0f65-0318-4ed2-a08f-eb3ebc89955f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:12.613124 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a9d0f65-0318-4ed2-a08f-eb3ebc89955f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:12.613555 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a9d0f65-0318-4ed2-a08f-eb3ebc89955f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:12.614676 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a9d0f65-0318-4ed2-a08f-eb3ebc89955f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:12.615112 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a9d0f65-0318-4ed2-a08f-eb3ebc89955f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:12.894389 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fb1e4b9d-cf09-475f-9e9b-a38757972959 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:12.895857 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fb1e4b9d-cf09-475f-9e9b-a38757972959 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:12.920402 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb1e4b9d-cf09-475f-9e9b-a38757972959 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:12.921340 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb1e4b9d-cf09-475f-9e9b-a38757972959 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:12.922516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb1e4b9d-cf09-475f-9e9b-a38757972959 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:12.926430 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb1e4b9d-cf09-475f-9e9b-a38757972959 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:12.951920 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:12.962013 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7a9d0f65-0318-4ed2-a08f-eb3ebc89955f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:12.979959 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7a9d0f65-0318-4ed2-a08f-eb3ebc89955f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:12.991788 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7a9d0f65-0318-4ed2-a08f-eb3ebc89955f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:12.995269 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7a9d0f65-0318-4ed2-a08f-eb3ebc89955f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1748 microversion: 2.20 time: 0.401338 Jul 07 07:23:13.014035 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 178/347] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:12 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1748 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:13.043614 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fb1e4b9d-cf09-475f-9e9b-a38757972959 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:13.063523 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fb1e4b9d-cf09-475f-9e9b-a38757972959 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1304 microversion: 2.1 time: 0.174851 Jul 07 07:23:13.073306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 170/348] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:12 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1304 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:14.020392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7f48e2a1-0e9c-418a-9528-3d5000c438b7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:14.022346 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7f48e2a1-0e9c-418a-9528-3d5000c438b7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:14.038760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f48e2a1-0e9c-418a-9528-3d5000c438b7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:14.041507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f48e2a1-0e9c-418a-9528-3d5000c438b7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:14.042680 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f48e2a1-0e9c-418a-9528-3d5000c438b7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:14.044988 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f48e2a1-0e9c-418a-9528-3d5000c438b7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:14.085511 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f7c8662-e273-48fc-935d-062a13d2e9d3 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:14.088407 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f7c8662-e273-48fc-935d-062a13d2e9d3 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:14.105011 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f7c8662-e273-48fc-935d-062a13d2e9d3 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:14.107220 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f7c8662-e273-48fc-935d-062a13d2e9d3 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:14.108353 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f7c8662-e273-48fc-935d-062a13d2e9d3 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:14.109785 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f7c8662-e273-48fc-935d-062a13d2e9d3 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:14.576209 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f7c8662-e273-48fc-935d-062a13d2e9d3 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:14.585577 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f7c8662-e273-48fc-935d-062a13d2e9d3 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.505719 Jul 07 07:23:14.595920 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 171/349] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:14 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:14.602648 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-af56bd2e-a823-42c9-941a-ddb496e81aff req-a877eb49-98fb-4efc-a4aa-d9a1e3753ccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c68b9418-cc4f-41da-8dba-1ef31555120e", "tag": "2522ba46-c373-47c1-914e-51023019a66c"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:14.609470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7f48e2a1-0e9c-418a-9528-3d5000c438b7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:14.615185 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-af56bd2e-a823-42c9-941a-ddb496e81aff req-a877eb49-98fb-4efc-a4aa-d9a1e3753ccc service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:14.616084 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-af56bd2e-a823-42c9-941a-ddb496e81aff req-a877eb49-98fb-4efc-a4aa-d9a1e3753ccc service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:14.633650 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-af56bd2e-a823-42c9-941a-ddb496e81aff req-a877eb49-98fb-4efc-a4aa-d9a1e3753ccc service nova] Creating event network-changed:2522ba46-c373-47c1-914e-51023019a66c for instance c68b9418-cc4f-41da-8dba-1ef31555120e on hv-cinder-82660 Jul 07 07:23:14.635437 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7f48e2a1-0e9c-418a-9528-3d5000c438b7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:14.637107 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7f48e2a1-0e9c-418a-9528-3d5000c438b7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:14.638384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7f48e2a1-0e9c-418a-9528-3d5000c438b7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1750 microversion: 2.20 time: 0.623067 Jul 07 07:23:14.647587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 179/350] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:14 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1750 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:14.653367 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-af56bd2e-a823-42c9-941a-ddb496e81aff req-a877eb49-98fb-4efc-a4aa-d9a1e3753ccc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055166 Jul 07 07:23:14.655295 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 172/351] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:23:14.656444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-767479634", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-945349269", "security_groups": [{"name": "tempest-secgroup-smoke-724118789"}], "networks": [{"uuid": "085dd514-76c3-4a72-af68-fc04aa70dd45"}], "block_device_mapping_v2": [{"uuid": "0a3c1221-59d7-467b-9a9e-0b3a0ad81055", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:14.840679 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] validate_networks() for [('085dd514-76c3-4a72-af68-fc04aa70dd45', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:23:15.597832 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:23:15.598591 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:23:15.599251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:23:15.599825 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:23:15.600494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:23:15.603730 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-928db267-562b-46d1-8906-c8b45365cae9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:15.604630 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-928db267-562b-46d1-8906-c8b45365cae9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:15.611543 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-928db267-562b-46d1-8906-c8b45365cae9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:15.612011 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-928db267-562b-46d1-8906-c8b45365cae9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:15.612791 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-928db267-562b-46d1-8906-c8b45365cae9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:15.613260 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-928db267-562b-46d1-8906-c8b45365cae9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:15.616732 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:15.617182 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:15.618011 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:15.618443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:15.640042 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Getting quotas for project 9ee25b35791243e698a41375cca91cea. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:23:15.644317 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Getting quotas for user e1f0d73f1807487ca3eb016660b29f47 and project 9ee25b35791243e698a41375cca91cea. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:23:15.723392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:23:15.725819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a3c1221-59d7-467b-9a9e-0b3a0ad81055',volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:23:15.896724 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cc545866-8795-401d-a653-d39b5cbf546e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.247834 Jul 07 07:23:15.897856 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 180/352] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:23:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:23:15.900933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-928db267-562b-46d1-8906-c8b45365cae9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:15.907071 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d73ca1ee-db64-44e3-a3b4-974bfb61ffdd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:15.907676 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d73ca1ee-db64-44e3-a3b4-974bfb61ffdd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:15.914186 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d73ca1ee-db64-44e3-a3b4-974bfb61ffdd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:15.914989 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d73ca1ee-db64-44e3-a3b4-974bfb61ffdd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:15.915945 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d73ca1ee-db64-44e3-a3b4-974bfb61ffdd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:15.916523 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d73ca1ee-db64-44e3-a3b4-974bfb61ffdd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:15.923250 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-928db267-562b-46d1-8906-c8b45365cae9 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.323305 Jul 07 07:23:15.926862 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 173/353] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:15 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:15.951141 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-972f69ed-e66e-4ecf-bc07-2f6e5778f2af tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:15.953587 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-972f69ed-e66e-4ecf-bc07-2f6e5778f2af tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:16.322566 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-972f69ed-e66e-4ecf-bc07-2f6e5778f2af tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:16.339708 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-972f69ed-e66e-4ecf-bc07-2f6e5778f2af tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1087 microversion: 2.1 time: 0.408596 Jul 07 07:23:16.349267 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 174/354] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:15 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1087 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:16.448730 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d73ca1ee-db64-44e3-a3b4-974bfb61ffdd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:16.460726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d73ca1ee-db64-44e3-a3b4-974bfb61ffdd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:16.462406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d73ca1ee-db64-44e3-a3b4-974bfb61ffdd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:16.463488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d73ca1ee-db64-44e3-a3b4-974bfb61ffdd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.560344 Jul 07 07:23:16.464671 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 181/355] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:15 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:16.946378 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f2477210-30f4-4e5e-9f40-a92e6ad47e5f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:16.948712 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f2477210-30f4-4e5e-9f40-a92e6ad47e5f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:16.957258 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2477210-30f4-4e5e-9f40-a92e6ad47e5f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:16.958587 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2477210-30f4-4e5e-9f40-a92e6ad47e5f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:16.959922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2477210-30f4-4e5e-9f40-a92e6ad47e5f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:16.960573 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2477210-30f4-4e5e-9f40-a92e6ad47e5f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:17.352489 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f2477210-30f4-4e5e-9f40-a92e6ad47e5f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:17.359867 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eeb3ab82-5847-4871-9b8d-aa2a305e62c2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:17.361197 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eeb3ab82-5847-4871-9b8d-aa2a305e62c2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:17.362138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f2477210-30f4-4e5e-9f40-a92e6ad47e5f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.422700 Jul 07 07:23:17.374469 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 175/356] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:16 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:17.380263 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eeb3ab82-5847-4871-9b8d-aa2a305e62c2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:17.381386 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eeb3ab82-5847-4871-9b8d-aa2a305e62c2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:17.382529 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eeb3ab82-5847-4871-9b8d-aa2a305e62c2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:17.383147 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eeb3ab82-5847-4871-9b8d-aa2a305e62c2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:17.481404 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-be66540b-7877-4c98-b27a-a75734f8d21d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:17.482275 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-be66540b-7877-4c98-b27a-a75734f8d21d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:17.488967 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-be66540b-7877-4c98-b27a-a75734f8d21d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:17.489517 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-be66540b-7877-4c98-b27a-a75734f8d21d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:17.490196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-be66540b-7877-4c98-b27a-a75734f8d21d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:17.490620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-be66540b-7877-4c98-b27a-a75734f8d21d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:17.565583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eeb3ab82-5847-4871-9b8d-aa2a305e62c2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:17.574226 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eeb3ab82-5847-4871-9b8d-aa2a305e62c2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1185 microversion: 2.1 time: 0.218063 Jul 07 07:23:17.574892 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 182/357] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:17 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1185 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:17.784718 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-be66540b-7877-4c98-b27a-a75734f8d21d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:17.797321 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-be66540b-7877-4c98-b27a-a75734f8d21d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:17.798604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-be66540b-7877-4c98-b27a-a75734f8d21d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:17.799873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-be66540b-7877-4c98-b27a-a75734f8d21d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.322426 Jul 07 07:23:17.811660 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 176/358] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:17 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:23:18.382490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-373e3629-1698-4cea-a8ce-4b2bec416e3b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:18.383049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-373e3629-1698-4cea-a8ce-4b2bec416e3b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:18.397678 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-373e3629-1698-4cea-a8ce-4b2bec416e3b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:18.398376 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-373e3629-1698-4cea-a8ce-4b2bec416e3b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:18.399315 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-373e3629-1698-4cea-a8ce-4b2bec416e3b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:18.400085 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-373e3629-1698-4cea-a8ce-4b2bec416e3b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:18.595124 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b9d5d363-9fdb-46b7-af39-602427ea8edb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:18.595671 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b9d5d363-9fdb-46b7-af39-602427ea8edb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:18.614846 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9d5d363-9fdb-46b7-af39-602427ea8edb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:18.615310 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9d5d363-9fdb-46b7-af39-602427ea8edb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:18.616841 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9d5d363-9fdb-46b7-af39-602427ea8edb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:18.617491 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9d5d363-9fdb-46b7-af39-602427ea8edb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:18.715028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-373e3629-1698-4cea-a8ce-4b2bec416e3b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:18.729021 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-373e3629-1698-4cea-a8ce-4b2bec416e3b tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.350596 Jul 07 07:23:18.739533 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 183/359] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:18 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:18.760073 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b9d5d363-9fdb-46b7-af39-602427ea8edb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:18.770534 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b9d5d363-9fdb-46b7-af39-602427ea8edb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1203 microversion: 2.1 time: 0.178710 Jul 07 07:23:18.772649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 177/360] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:18 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1203 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:18.819872 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c9177e5c-50c7-4148-8f10-94f3e51d3336 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:18.825000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c9177e5c-50c7-4148-8f10-94f3e51d3336 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:18.835779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c9177e5c-50c7-4148-8f10-94f3e51d3336 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:18.836492 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c9177e5c-50c7-4148-8f10-94f3e51d3336 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:18.837367 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c9177e5c-50c7-4148-8f10-94f3e51d3336 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:18.837949 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c9177e5c-50c7-4148-8f10-94f3e51d3336 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:18.843863 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:19.130349 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c9177e5c-50c7-4148-8f10-94f3e51d3336 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:19.147669 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c9177e5c-50c7-4148-8f10-94f3e51d3336 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:19.149414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c9177e5c-50c7-4148-8f10-94f3e51d3336 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:19.176803 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c9177e5c-50c7-4148-8f10-94f3e51d3336 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.335817 Jul 07 07:23:19.177485 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 184/361] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:18 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:19.450001 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-13db8b68-75f4-4f0f-9843-e48744ae8e7d req-6c87c043-2bf2-4009-8c2a-161e428978ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68b9418-cc4f-41da-8dba-1ef31555120e", "name": "network-vif-plugged", "status": "completed", "tag": "2522ba46-c373-47c1-914e-51023019a66c"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:19.463031 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-13db8b68-75f4-4f0f-9843-e48744ae8e7d req-6c87c043-2bf2-4009-8c2a-161e428978ef service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:19.464287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-13db8b68-75f4-4f0f-9843-e48744ae8e7d req-6c87c043-2bf2-4009-8c2a-161e428978ef service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:19.489613 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-13db8b68-75f4-4f0f-9843-e48744ae8e7d req-6c87c043-2bf2-4009-8c2a-161e428978ef service nova] Creating event network-vif-plugged:2522ba46-c373-47c1-914e-51023019a66c for instance c68b9418-cc4f-41da-8dba-1ef31555120e on hv-cinder-82660 Jul 07 07:23:19.501632 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-13db8b68-75f4-4f0f-9843-e48744ae8e7d req-6c87c043-2bf2-4009-8c2a-161e428978ef service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057016 Jul 07 07:23:19.503516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 178/362] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:23:19.753691 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e31be0d6-c927-427c-afa8-f014de8a05b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:19.763647 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e31be0d6-c927-427c-afa8-f014de8a05b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:19.790821 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d59ee01c-d98d-4738-9d89-11b4018acd1f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:19.792188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d59ee01c-d98d-4738-9d89-11b4018acd1f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:19.801714 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e31be0d6-c927-427c-afa8-f014de8a05b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:19.808259 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e31be0d6-c927-427c-afa8-f014de8a05b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:19.809976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e31be0d6-c927-427c-afa8-f014de8a05b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:19.811605 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e31be0d6-c927-427c-afa8-f014de8a05b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:19.813654 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d59ee01c-d98d-4738-9d89-11b4018acd1f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:19.814438 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d59ee01c-d98d-4738-9d89-11b4018acd1f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:19.817428 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d59ee01c-d98d-4738-9d89-11b4018acd1f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:19.836035 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d59ee01c-d98d-4738-9d89-11b4018acd1f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:20.606536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:20.759798 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d59ee01c-d98d-4738-9d89-11b4018acd1f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:20.768951 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d59ee01c-d98d-4738-9d89-11b4018acd1f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.983271 Jul 07 07:23:20.772258 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 179/363] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:19 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:20.779947 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f52da140-0d34-4197-9516-fea983592d38 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:20.796097 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f52da140-0d34-4197-9516-fea983592d38 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:20.829702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f52da140-0d34-4197-9516-fea983592d38 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:20.830286 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f52da140-0d34-4197-9516-fea983592d38 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:20.831193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f52da140-0d34-4197-9516-fea983592d38 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:20.831640 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f52da140-0d34-4197-9516-fea983592d38 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:20.858683 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e31be0d6-c927-427c-afa8-f014de8a05b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:20.868987 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e31be0d6-c927-427c-afa8-f014de8a05b1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 1.123289 Jul 07 07:23:20.869646 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 185/364] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:19 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:21.171323 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f52da140-0d34-4197-9516-fea983592d38 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:21.181706 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f52da140-0d34-4197-9516-fea983592d38 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:21.183517 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f52da140-0d34-4197-9516-fea983592d38 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:21.185159 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f52da140-0d34-4197-9516-fea983592d38 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.411732 Jul 07 07:23:21.186272 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 180/365] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:20 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:21.400985 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-8f3ad391-e6d9-43aa-b00d-8179330e94ce req-259ccd24-0ef4-4e56-ad49-28eab909c998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83944e7d-3750-4747-92ae-6a1f735c79fc", "tag": "19dfde08-41d9-41e9-b31b-405a6dc8008a"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:21.412866 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-8f3ad391-e6d9-43aa-b00d-8179330e94ce req-259ccd24-0ef4-4e56-ad49-28eab909c998 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:21.413627 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-8f3ad391-e6d9-43aa-b00d-8179330e94ce req-259ccd24-0ef4-4e56-ad49-28eab909c998 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:21.434666 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-8f3ad391-e6d9-43aa-b00d-8179330e94ce req-259ccd24-0ef4-4e56-ad49-28eab909c998 service nova] Creating event network-changed:19dfde08-41d9-41e9-b31b-405a6dc8008a for instance 83944e7d-3750-4747-92ae-6a1f735c79fc on hv-cinder-82660 Jul 07 07:23:21.452692 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-8f3ad391-e6d9-43aa-b00d-8179330e94ce req-259ccd24-0ef4-4e56-ad49-28eab909c998 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056107 Jul 07 07:23:21.453602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 186/366] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:23:21.790563 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f2ffe7a2-d873-4668-bc02-e7219416493a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:21.791182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f2ffe7a2-d873-4668-bc02-e7219416493a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:21.813453 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2ffe7a2-d873-4668-bc02-e7219416493a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:21.814939 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2ffe7a2-d873-4668-bc02-e7219416493a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:21.819180 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2ffe7a2-d873-4668-bc02-e7219416493a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:21.820013 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f2ffe7a2-d873-4668-bc02-e7219416493a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:21.886724 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b015fb07-46a3-42da-978d-a972551dd773 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:21.887585 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b015fb07-46a3-42da-978d-a972551dd773 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:21.899844 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b015fb07-46a3-42da-978d-a972551dd773 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:21.911054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b015fb07-46a3-42da-978d-a972551dd773 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:21.911955 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b015fb07-46a3-42da-978d-a972551dd773 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:21.912396 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b015fb07-46a3-42da-978d-a972551dd773 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:22.089372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f2ffe7a2-d873-4668-bc02-e7219416493a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:22.102064 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f2ffe7a2-d873-4668-bc02-e7219416493a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.315352 Jul 07 07:23:22.109919 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 181/367] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:21 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:22.149102 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b015fb07-46a3-42da-978d-a972551dd773 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:22.159008 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b015fb07-46a3-42da-978d-a972551dd773 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.276311 Jul 07 07:23:22.160125 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 187/368] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:21 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:22.204263 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2ae6d3a1-a4d2-4f61-8a25-abaaf70dd3bf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:22.204881 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2ae6d3a1-a4d2-4f61-8a25-abaaf70dd3bf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:22.215309 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ae6d3a1-a4d2-4f61-8a25-abaaf70dd3bf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:22.215769 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ae6d3a1-a4d2-4f61-8a25-abaaf70dd3bf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:22.223615 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ae6d3a1-a4d2-4f61-8a25-abaaf70dd3bf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:22.224531 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ae6d3a1-a4d2-4f61-8a25-abaaf70dd3bf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:22.427748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2ae6d3a1-a4d2-4f61-8a25-abaaf70dd3bf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:22.441454 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2ae6d3a1-a4d2-4f61-8a25-abaaf70dd3bf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:22.443202 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2ae6d3a1-a4d2-4f61-8a25-abaaf70dd3bf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:22.445631 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2ae6d3a1-a4d2-4f61-8a25-abaaf70dd3bf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.245052 Jul 07 07:23:22.457907 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 182/369] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:22 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:23.128186 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-00beebfb-3e7b-4077-bf88-11fca57388b0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:23.128802 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-00beebfb-3e7b-4077-bf88-11fca57388b0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:23.156943 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00beebfb-3e7b-4077-bf88-11fca57388b0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:23.157418 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00beebfb-3e7b-4077-bf88-11fca57388b0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:23.160478 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00beebfb-3e7b-4077-bf88-11fca57388b0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:23.160915 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00beebfb-3e7b-4077-bf88-11fca57388b0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:23.178464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d6c91160-d1a3-4c76-871e-ae4f936e9443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:23.179930 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d6c91160-d1a3-4c76-871e-ae4f936e9443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:23.206881 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6c91160-d1a3-4c76-871e-ae4f936e9443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:23.207678 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6c91160-d1a3-4c76-871e-ae4f936e9443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:23.208677 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6c91160-d1a3-4c76-871e-ae4f936e9443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:23.211235 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d6c91160-d1a3-4c76-871e-ae4f936e9443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:23.722713 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-00beebfb-3e7b-4077-bf88-11fca57388b0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:23.766493 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-00beebfb-3e7b-4077-bf88-11fca57388b0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.642076 Jul 07 07:23:23.768425 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 188/370] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:23 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:23.781673 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d6c91160-d1a3-4c76-871e-ae4f936e9443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:23.787038 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dd7ba3b9-2c6c-4239-abbb-a3a000671723 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:23.789993 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dd7ba3b9-2c6c-4239-abbb-a3a000671723 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:23.795289 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d6c91160-d1a3-4c76-871e-ae4f936e9443 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.620928 Jul 07 07:23:23.808654 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 183/371] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:23 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:23.815757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd7ba3b9-2c6c-4239-abbb-a3a000671723 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:23.818998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd7ba3b9-2c6c-4239-abbb-a3a000671723 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:23.820807 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd7ba3b9-2c6c-4239-abbb-a3a000671723 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:23.822320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dd7ba3b9-2c6c-4239-abbb-a3a000671723 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:24.329485 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dd7ba3b9-2c6c-4239-abbb-a3a000671723 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:24.340505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dd7ba3b9-2c6c-4239-abbb-a3a000671723 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:24.346187 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dd7ba3b9-2c6c-4239-abbb-a3a000671723 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:24.348970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dd7ba3b9-2c6c-4239-abbb-a3a000671723 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.578382 Jul 07 07:23:24.355953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 189/372] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:23 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:24.798488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-63f834a9-98c4-442b-aeab-80eb8996559e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:24.799964 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-63f834a9-98c4-442b-aeab-80eb8996559e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:24.815486 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b506329c-e072-4ee5-b1cb-bb3e0e8d6e90 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:24.816461 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b506329c-e072-4ee5-b1cb-bb3e0e8d6e90 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:24.834779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b506329c-e072-4ee5-b1cb-bb3e0e8d6e90 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:24.835234 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b506329c-e072-4ee5-b1cb-bb3e0e8d6e90 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:24.836032 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b506329c-e072-4ee5-b1cb-bb3e0e8d6e90 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:24.836470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b506329c-e072-4ee5-b1cb-bb3e0e8d6e90 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:24.839457 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f834a9-98c4-442b-aeab-80eb8996559e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:24.839917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f834a9-98c4-442b-aeab-80eb8996559e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:24.840698 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f834a9-98c4-442b-aeab-80eb8996559e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:24.841193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63f834a9-98c4-442b-aeab-80eb8996559e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:25.609201 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b506329c-e072-4ee5-b1cb-bb3e0e8d6e90 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:25.616772 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63f834a9-98c4-442b-aeab-80eb8996559e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:25.626912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-63f834a9-98c4-442b-aeab-80eb8996559e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.834255 Jul 07 07:23:25.631462 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b506329c-e072-4ee5-b1cb-bb3e0e8d6e90 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.823226 Jul 07 07:23:25.637778 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 190/373] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:24 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:25.647121 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 184/374] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:24 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:25.653402 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-554b476a-ce77-4102-8c60-baa406ad651c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:25.656391 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-554b476a-ce77-4102-8c60-baa406ad651c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:25.663129 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:25.664823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:25.668136 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-554b476a-ce77-4102-8c60-baa406ad651c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:25.669071 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-554b476a-ce77-4102-8c60-baa406ad651c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:25.670110 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-554b476a-ce77-4102-8c60-baa406ad651c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:25.670753 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-554b476a-ce77-4102-8c60-baa406ad651c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:26.107111 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-554b476a-ce77-4102-8c60-baa406ad651c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:26.119602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-554b476a-ce77-4102-8c60-baa406ad651c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:26.121431 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-554b476a-ce77-4102-8c60-baa406ad651c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:26.124326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-554b476a-ce77-4102-8c60-baa406ad651c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.485089 Jul 07 07:23:26.133324 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 191/375] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:25 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:26.645701 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-37a4fb43-29ad-4596-af9b-3f608be07af3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:26.646487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-37a4fb43-29ad-4596-af9b-3f608be07af3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:26.655516 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-586c5b6f-734d-48ef-84ab-dc7af95c7fb7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:26.656348 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-586c5b6f-734d-48ef-84ab-dc7af95c7fb7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:26.665657 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-586c5b6f-734d-48ef-84ab-dc7af95c7fb7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:26.667024 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=14 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:26.668945 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a4fb43-29ad-4596-af9b-3f608be07af3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:26.669441 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a4fb43-29ad-4596-af9b-3f608be07af3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:26.670257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a4fb43-29ad-4596-af9b-3f608be07af3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:26.670707 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-37a4fb43-29ad-4596-af9b-3f608be07af3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:26.679360 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-586c5b6f-734d-48ef-84ab-dc7af95c7fb7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:26.680533 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-586c5b6f-734d-48ef-84ab-dc7af95c7fb7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:26.681141 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-586c5b6f-734d-48ef-84ab-dc7af95c7fb7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:26.984540 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-37a4fb43-29ad-4596-af9b-3f608be07af3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:27.001859 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-37a4fb43-29ad-4596-af9b-3f608be07af3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.360897 Jul 07 07:23:27.009312 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-586c5b6f-734d-48ef-84ab-dc7af95c7fb7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:27.013680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 185/376] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:26 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:27.019666 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-586c5b6f-734d-48ef-84ab-dc7af95c7fb7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.367749 Jul 07 07:23:27.020827 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 192/377] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:26 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:27.143194 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4fa4951d-731a-40f7-bb15-d13d594d6bb6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:27.143996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4fa4951d-731a-40f7-bb15-d13d594d6bb6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:27.157273 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fa4951d-731a-40f7-bb15-d13d594d6bb6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:27.158120 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fa4951d-731a-40f7-bb15-d13d594d6bb6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:27.159266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fa4951d-731a-40f7-bb15-d13d594d6bb6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:27.159914 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fa4951d-731a-40f7-bb15-d13d594d6bb6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:27.444672 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4fa4951d-731a-40f7-bb15-d13d594d6bb6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:27.461288 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4fa4951d-731a-40f7-bb15-d13d594d6bb6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:27.463032 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4fa4951d-731a-40f7-bb15-d13d594d6bb6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:27.464417 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4fa4951d-731a-40f7-bb15-d13d594d6bb6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.325398 Jul 07 07:23:27.493630 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 186/378] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:27 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:28.019649 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-23858e23-1362-48d4-83bf-3c64a4ac4f9b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:28.020330 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-23858e23-1362-48d4-83bf-3c64a4ac4f9b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:28.036005 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1e8a0673-ceb7-4b97-a10b-cab024088079 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:28.036843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1e8a0673-ceb7-4b97-a10b-cab024088079 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:28.042065 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23858e23-1362-48d4-83bf-3c64a4ac4f9b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:28.042648 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23858e23-1362-48d4-83bf-3c64a4ac4f9b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:28.043484 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23858e23-1362-48d4-83bf-3c64a4ac4f9b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:28.043918 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23858e23-1362-48d4-83bf-3c64a4ac4f9b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:28.046091 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e8a0673-ceb7-4b97-a10b-cab024088079 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:28.047889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e8a0673-ceb7-4b97-a10b-cab024088079 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:28.048686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e8a0673-ceb7-4b97-a10b-cab024088079 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:28.049122 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1e8a0673-ceb7-4b97-a10b-cab024088079 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:28.487262 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-23858e23-1362-48d4-83bf-3c64a4ac4f9b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:28.503169 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-23858e23-1362-48d4-83bf-3c64a4ac4f9b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.487757 Jul 07 07:23:28.513244 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 193/379] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:28 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:28.518699 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f49be56e-351c-4f9f-add0-371b5796dd2c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:28.522034 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f49be56e-351c-4f9f-add0-371b5796dd2c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:28.536813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f49be56e-351c-4f9f-add0-371b5796dd2c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:28.537666 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f49be56e-351c-4f9f-add0-371b5796dd2c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:28.538692 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f49be56e-351c-4f9f-add0-371b5796dd2c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:28.542429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f49be56e-351c-4f9f-add0-371b5796dd2c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:28.565019 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1e8a0673-ceb7-4b97-a10b-cab024088079 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:28.583270 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1e8a0673-ceb7-4b97-a10b-cab024088079 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.551045 Jul 07 07:23:28.585909 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 187/380] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:28 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:28.765476 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f49be56e-351c-4f9f-add0-371b5796dd2c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:28.776118 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f49be56e-351c-4f9f-add0-371b5796dd2c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:28.779205 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f49be56e-351c-4f9f-add0-371b5796dd2c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:28.780659 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f49be56e-351c-4f9f-add0-371b5796dd2c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.266016 Jul 07 07:23:28.781849 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 194/381] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:28 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:29.522809 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b0ae2caa-f614-4b76-964c-4c66356b8bad tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:29.523440 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b0ae2caa-f614-4b76-964c-4c66356b8bad tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:29.536819 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b0ae2caa-f614-4b76-964c-4c66356b8bad tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:29.553154 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b0ae2caa-f614-4b76-964c-4c66356b8bad tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:29.556721 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b0ae2caa-f614-4b76-964c-4c66356b8bad tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:29.557972 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b0ae2caa-f614-4b76-964c-4c66356b8bad tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:29.603219 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6250ca15-02a9-4ffb-9a43-d3c1589f50bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:29.603835 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6250ca15-02a9-4ffb-9a43-d3c1589f50bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:29.619216 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6250ca15-02a9-4ffb-9a43-d3c1589f50bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:29.619651 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6250ca15-02a9-4ffb-9a43-d3c1589f50bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:29.620636 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6250ca15-02a9-4ffb-9a43-d3c1589f50bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:29.621072 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6250ca15-02a9-4ffb-9a43-d3c1589f50bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:29.884706 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b0ae2caa-f614-4b76-964c-4c66356b8bad tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:29.896633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b0ae2caa-f614-4b76-964c-4c66356b8bad tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.378907 Jul 07 07:23:29.908372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 188/382] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:29 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:29.913205 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6250ca15-02a9-4ffb-9a43-d3c1589f50bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:29.922361 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6250ca15-02a9-4ffb-9a43-d3c1589f50bb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.322980 Jul 07 07:23:29.926127 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-06cf8ceb-07d2-4d61-951f-5bca76e03011 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:29.926766 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-06cf8ceb-07d2-4d61-951f-5bca76e03011 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:29.933706 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06cf8ceb-07d2-4d61-951f-5bca76e03011 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:29.934373 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06cf8ceb-07d2-4d61-951f-5bca76e03011 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:29.934692 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 195/383] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:29 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:29.935353 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06cf8ceb-07d2-4d61-951f-5bca76e03011 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:29.936177 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06cf8ceb-07d2-4d61-951f-5bca76e03011 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:29.957233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:30.087498 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-06cf8ceb-07d2-4d61-951f-5bca76e03011 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:30.096554 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-06cf8ceb-07d2-4d61-951f-5bca76e03011 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:30.098748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-06cf8ceb-07d2-4d61-951f-5bca76e03011 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:30.099911 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-06cf8ceb-07d2-4d61-951f-5bca76e03011 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.190131 Jul 07 07:23:30.100471 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 189/384] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:29 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:30.914656 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-abb84829-603f-43e8-bf8d-3a56b849c73d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:30.915301 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-abb84829-603f-43e8-bf8d-3a56b849c73d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:30.922649 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abb84829-603f-43e8-bf8d-3a56b849c73d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:30.923099 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abb84829-603f-43e8-bf8d-3a56b849c73d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:30.923889 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abb84829-603f-43e8-bf8d-3a56b849c73d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:30.924324 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-abb84829-603f-43e8-bf8d-3a56b849c73d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:30.941730 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8436ff01-add5-43d0-b32f-920a6e0fca02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:30.946529 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8436ff01-add5-43d0-b32f-920a6e0fca02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:30.956451 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8436ff01-add5-43d0-b32f-920a6e0fca02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:30.957395 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8436ff01-add5-43d0-b32f-920a6e0fca02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:30.958923 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8436ff01-add5-43d0-b32f-920a6e0fca02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:30.959824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8436ff01-add5-43d0-b32f-920a6e0fca02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:31.469639 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-abb84829-603f-43e8-bf8d-3a56b849c73d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:31.480503 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-abb84829-603f-43e8-bf8d-3a56b849c73d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.569577 Jul 07 07:23:31.494751 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 196/385] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:30 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:31.500211 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ed713dc3-fb0b-49d2-9989-20184a0de096 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:31.501246 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ed713dc3-fb0b-49d2-9989-20184a0de096 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:31.512429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ed713dc3-fb0b-49d2-9989-20184a0de096 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:31.513124 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ed713dc3-fb0b-49d2-9989-20184a0de096 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:31.514263 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ed713dc3-fb0b-49d2-9989-20184a0de096 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:31.515447 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ed713dc3-fb0b-49d2-9989-20184a0de096 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:31.560683 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8436ff01-add5-43d0-b32f-920a6e0fca02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:31.572903 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8436ff01-add5-43d0-b32f-920a6e0fca02 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1372 microversion: 2.1 time: 0.636635 Jul 07 07:23:31.573850 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 190/386] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:30 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1372 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:31.680906 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ed713dc3-fb0b-49d2-9989-20184a0de096 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:31.690990 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ed713dc3-fb0b-49d2-9989-20184a0de096 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:31.692845 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ed713dc3-fb0b-49d2-9989-20184a0de096 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:31.694315 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ed713dc3-fb0b-49d2-9989-20184a0de096 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.198401 Jul 07 07:23:31.695150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 197/387] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:31 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:32.339463 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b3e39a5a-0517-4e8e-a8ab-d12ef4f15445 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:32.340729 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b3e39a5a-0517-4e8e-a8ab-d12ef4f15445 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:32.342807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:32.350953 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3e39a5a-0517-4e8e-a8ab-d12ef4f15445 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:32.351757 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3e39a5a-0517-4e8e-a8ab-d12ef4f15445 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:32.353241 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3e39a5a-0517-4e8e-a8ab-d12ef4f15445 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:32.353879 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3e39a5a-0517-4e8e-a8ab-d12ef4f15445 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:32.499244 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7d86fe8a-73da-46fe-bfce-98f24b35fd1d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:32.499859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7d86fe8a-73da-46fe-bfce-98f24b35fd1d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:32.509133 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d86fe8a-73da-46fe-bfce-98f24b35fd1d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:32.509895 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d86fe8a-73da-46fe-bfce-98f24b35fd1d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:32.510396 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d86fe8a-73da-46fe-bfce-98f24b35fd1d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:32.510996 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d86fe8a-73da-46fe-bfce-98f24b35fd1d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:32.560574 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-b3e39a5a-0517-4e8e-a8ab-d12ef4f15445 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lazy-loading 'services' on Instance uuid ec188266-15a7-4559-ab29-6025dd7837e5 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:23:32.710181 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7d86fe8a-73da-46fe-bfce-98f24b35fd1d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:32.720658 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7d86fe8a-73da-46fe-bfce-98f24b35fd1d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.225370 Jul 07 07:23:32.721529 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 198/388] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:32 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:32.737526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4044d0f5-f765-422c-9247-ed20f6dc9f27 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:32.738716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4044d0f5-f765-422c-9247-ed20f6dc9f27 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:32.748252 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4044d0f5-f765-422c-9247-ed20f6dc9f27 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:32.748767 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4044d0f5-f765-422c-9247-ed20f6dc9f27 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:32.749819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4044d0f5-f765-422c-9247-ed20f6dc9f27 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:32.750382 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4044d0f5-f765-422c-9247-ed20f6dc9f27 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:32.767245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b3e39a5a-0517-4e8e-a8ab-d12ef4f15445 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/os-volume_attachments/39941333-712c-4116-a43b-b7b7a59b3026" status: 202 len: 0 microversion: 2.1 time: 0.432322 Jul 07 07:23:32.773299 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 191/389] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:23:32 2022] DELETE /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/os-volume_attachments/39941333-712c-4116-a43b-b7b7a59b3026 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:23:32.783130 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ca7aa2ea-beca-46a7-98af-a013ae94157d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:32.786585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ca7aa2ea-beca-46a7-98af-a013ae94157d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:32.800600 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca7aa2ea-beca-46a7-98af-a013ae94157d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:32.801062 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca7aa2ea-beca-46a7-98af-a013ae94157d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:32.801857 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca7aa2ea-beca-46a7-98af-a013ae94157d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:32.802288 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca7aa2ea-beca-46a7-98af-a013ae94157d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:33.145189 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ca7aa2ea-beca-46a7-98af-a013ae94157d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:33.150674 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4044d0f5-f765-422c-9247-ed20f6dc9f27 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:33.158933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ca7aa2ea-beca-46a7-98af-a013ae94157d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:33.162011 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ca7aa2ea-beca-46a7-98af-a013ae94157d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:33.162229 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4044d0f5-f765-422c-9247-ed20f6dc9f27 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1565 microversion: 2.1 time: 0.439270 Jul 07 07:23:33.163773 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ca7aa2ea-beca-46a7-98af-a013ae94157d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.391672 Jul 07 07:23:33.164584 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 192/390] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:32 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:33.167597 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 199/391] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:32 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1565 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:33.190239 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-66831c1d-3210-4a4b-aaa3-c818002a9353 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:33.190742 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-66831c1d-3210-4a4b-aaa3-c818002a9353 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:33.197850 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66831c1d-3210-4a4b-aaa3-c818002a9353 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:33.198721 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66831c1d-3210-4a4b-aaa3-c818002a9353 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:33.199776 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66831c1d-3210-4a4b-aaa3-c818002a9353 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:33.200430 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66831c1d-3210-4a4b-aaa3-c818002a9353 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:33.297954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-66831c1d-3210-4a4b-aaa3-c818002a9353 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112234 Jul 07 07:23:33.298758 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 193/392] 10.222.0.62 () {58 vars in 1274 bytes} [Thu Jul 7 07:23:33 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:23:33.738937 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-10efec2c-0e19-4479-9dab-9c6f42684a97 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:33.739539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-10efec2c-0e19-4479-9dab-9c6f42684a97 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:33.751079 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10efec2c-0e19-4479-9dab-9c6f42684a97 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:33.753544 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10efec2c-0e19-4479-9dab-9c6f42684a97 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:33.755734 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10efec2c-0e19-4479-9dab-9c6f42684a97 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:33.756192 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10efec2c-0e19-4479-9dab-9c6f42684a97 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:33.989072 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-10efec2c-0e19-4479-9dab-9c6f42684a97 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:33.997683 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-10efec2c-0e19-4479-9dab-9c6f42684a97 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.262704 Jul 07 07:23:33.999942 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 200/393] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:33 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:34.199933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1a15149f-33b6-46f4-9669-7a1277751f9c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:34.204438 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1a15149f-33b6-46f4-9669-7a1277751f9c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:34.215593 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a15149f-33b6-46f4-9669-7a1277751f9c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:34.216404 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a15149f-33b6-46f4-9669-7a1277751f9c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:34.217815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a15149f-33b6-46f4-9669-7a1277751f9c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:34.218529 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1a15149f-33b6-46f4-9669-7a1277751f9c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:34.478449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1a15149f-33b6-46f4-9669-7a1277751f9c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:34.491816 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1a15149f-33b6-46f4-9669-7a1277751f9c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:34.493840 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1a15149f-33b6-46f4-9669-7a1277751f9c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:34.496171 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1a15149f-33b6-46f4-9669-7a1277751f9c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.301494 Jul 07 07:23:34.510248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 194/394] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:34 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:35.015674 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4eac5c24-34ee-4424-a6ed-bf821bcba812 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:35.016660 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4eac5c24-34ee-4424-a6ed-bf821bcba812 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:35.031215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4eac5c24-34ee-4424-a6ed-bf821bcba812 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:35.032038 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4eac5c24-34ee-4424-a6ed-bf821bcba812 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:35.033021 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4eac5c24-34ee-4424-a6ed-bf821bcba812 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:35.033764 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4eac5c24-34ee-4424-a6ed-bf821bcba812 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:35.063907 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-b8eabe59-36bc-4bda-b093-11b5100ca69d req-38521bc2-eca1-470b-ab80-21da505174e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c68b9418-cc4f-41da-8dba-1ef31555120e", "tag": "2522ba46-c373-47c1-914e-51023019a66c"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:35.065815 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:35.086237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b8eabe59-36bc-4bda-b093-11b5100ca69d req-38521bc2-eca1-470b-ab80-21da505174e6 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:35.086885 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b8eabe59-36bc-4bda-b093-11b5100ca69d req-38521bc2-eca1-470b-ab80-21da505174e6 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:35.105029 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-b8eabe59-36bc-4bda-b093-11b5100ca69d req-38521bc2-eca1-470b-ab80-21da505174e6 service nova] Creating event network-changed:2522ba46-c373-47c1-914e-51023019a66c for instance c68b9418-cc4f-41da-8dba-1ef31555120e on hv-cinder-82660 Jul 07 07:23:35.111225 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-b8eabe59-36bc-4bda-b093-11b5100ca69d req-38521bc2-eca1-470b-ab80-21da505174e6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051343 Jul 07 07:23:35.113078 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 195/395] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:23:35.216460 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4eac5c24-34ee-4424-a6ed-bf821bcba812 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:35.242904 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4eac5c24-34ee-4424-a6ed-bf821bcba812 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.231661 Jul 07 07:23:35.247438 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 201/396] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:35 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:35.516934 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c005edbc-8ad4-4cb6-93aa-b72e9f01853c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:35.519036 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c005edbc-8ad4-4cb6-93aa-b72e9f01853c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:35.526152 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c005edbc-8ad4-4cb6-93aa-b72e9f01853c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:35.526875 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c005edbc-8ad4-4cb6-93aa-b72e9f01853c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:35.527839 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c005edbc-8ad4-4cb6-93aa-b72e9f01853c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:35.533587 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c005edbc-8ad4-4cb6-93aa-b72e9f01853c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:35.746179 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c005edbc-8ad4-4cb6-93aa-b72e9f01853c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:35.758320 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c005edbc-8ad4-4cb6-93aa-b72e9f01853c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:35.760441 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c005edbc-8ad4-4cb6-93aa-b72e9f01853c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:35.761984 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c005edbc-8ad4-4cb6-93aa-b72e9f01853c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.249593 Jul 07 07:23:35.765847 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 196/397] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:35 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:36.264162 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-75a0c461-e78e-4a62-bd1f-11fdd2733897 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:36.265789 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-75a0c461-e78e-4a62-bd1f-11fdd2733897 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:36.279885 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75a0c461-e78e-4a62-bd1f-11fdd2733897 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:36.280345 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75a0c461-e78e-4a62-bd1f-11fdd2733897 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:36.281418 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75a0c461-e78e-4a62-bd1f-11fdd2733897 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:36.281847 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-75a0c461-e78e-4a62-bd1f-11fdd2733897 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:36.470326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-75a0c461-e78e-4a62-bd1f-11fdd2733897 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:36.477932 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-75a0c461-e78e-4a62-bd1f-11fdd2733897 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.217716 Jul 07 07:23:36.478523 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 202/398] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:36 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:36.783225 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-db930ae8-f103-4604-b2aa-4685ce77be01 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:36.783815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-db930ae8-f103-4604-b2aa-4685ce77be01 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:36.790482 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-db930ae8-f103-4604-b2aa-4685ce77be01 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:36.790933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-db930ae8-f103-4604-b2aa-4685ce77be01 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:36.791711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-db930ae8-f103-4604-b2aa-4685ce77be01 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:36.792316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-db930ae8-f103-4604-b2aa-4685ce77be01 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:36.942311 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-db930ae8-f103-4604-b2aa-4685ce77be01 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:36.951982 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-db930ae8-f103-4604-b2aa-4685ce77be01 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:36.953611 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-db930ae8-f103-4604-b2aa-4685ce77be01 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:36.954824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-db930ae8-f103-4604-b2aa-4685ce77be01 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.175524 Jul 07 07:23:36.955665 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 197/399] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:36 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:37.494999 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f9ea3990-00e0-484b-8dbd-eb67471fee25 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:37.495604 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f9ea3990-00e0-484b-8dbd-eb67471fee25 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:37.502320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9ea3990-00e0-484b-8dbd-eb67471fee25 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:37.505391 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9ea3990-00e0-484b-8dbd-eb67471fee25 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:37.506427 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9ea3990-00e0-484b-8dbd-eb67471fee25 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:37.507279 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f9ea3990-00e0-484b-8dbd-eb67471fee25 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:37.666480 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f9ea3990-00e0-484b-8dbd-eb67471fee25 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:37.674714 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f9ea3990-00e0-484b-8dbd-eb67471fee25 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.183645 Jul 07 07:23:37.675291 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 203/400] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:37 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:37.973836 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-801fff08-f8c0-4b20-bd56-4126a805359f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:37.974461 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-801fff08-f8c0-4b20-bd56-4126a805359f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:37.987378 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-801fff08-f8c0-4b20-bd56-4126a805359f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:37.988261 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-801fff08-f8c0-4b20-bd56-4126a805359f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:37.989693 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-801fff08-f8c0-4b20-bd56-4126a805359f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:37.990531 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-801fff08-f8c0-4b20-bd56-4126a805359f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:38.155959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-801fff08-f8c0-4b20-bd56-4126a805359f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:38.167953 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-801fff08-f8c0-4b20-bd56-4126a805359f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:38.169683 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-801fff08-f8c0-4b20-bd56-4126a805359f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:38.171030 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-801fff08-f8c0-4b20-bd56-4126a805359f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.201205 Jul 07 07:23:38.182456 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 198/401] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:37 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:38.692460 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e8913b59-b932-48fd-93a7-471edb2320fa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:38.693185 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e8913b59-b932-48fd-93a7-471edb2320fa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:38.700467 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8913b59-b932-48fd-93a7-471edb2320fa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:38.701707 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8913b59-b932-48fd-93a7-471edb2320fa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:38.701831 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8913b59-b932-48fd-93a7-471edb2320fa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:38.702381 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e8913b59-b932-48fd-93a7-471edb2320fa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:38.845795 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e8913b59-b932-48fd-93a7-471edb2320fa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:38.854061 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e8913b59-b932-48fd-93a7-471edb2320fa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.165335 Jul 07 07:23:38.854791 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 204/402] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:38 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:39.190350 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b5fdfc4e-6607-495c-9455-a784f89f5c79 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:39.191686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b5fdfc4e-6607-495c-9455-a784f89f5c79 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:39.198054 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5fdfc4e-6607-495c-9455-a784f89f5c79 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:39.198484 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5fdfc4e-6607-495c-9455-a784f89f5c79 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:39.199252 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5fdfc4e-6607-495c-9455-a784f89f5c79 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:39.199674 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b5fdfc4e-6607-495c-9455-a784f89f5c79 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:39.369027 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b5fdfc4e-6607-495c-9455-a784f89f5c79 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:39.378582 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b5fdfc4e-6607-495c-9455-a784f89f5c79 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:39.380119 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b5fdfc4e-6607-495c-9455-a784f89f5c79 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:39.381491 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b5fdfc4e-6607-495c-9455-a784f89f5c79 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.195415 Jul 07 07:23:39.382063 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 199/403] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:39 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:39.871208 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a0ea8761-5ddd-4f85-8a1a-3e9bac82fde2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:39.871668 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a0ea8761-5ddd-4f85-8a1a-3e9bac82fde2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:39.879981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0ea8761-5ddd-4f85-8a1a-3e9bac82fde2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:39.880665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0ea8761-5ddd-4f85-8a1a-3e9bac82fde2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:39.881653 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0ea8761-5ddd-4f85-8a1a-3e9bac82fde2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:39.882242 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0ea8761-5ddd-4f85-8a1a-3e9bac82fde2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:40.055341 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a0ea8761-5ddd-4f85-8a1a-3e9bac82fde2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:40.066709 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a0ea8761-5ddd-4f85-8a1a-3e9bac82fde2 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.199717 Jul 07 07:23:40.067888 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 205/404] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:39 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:40.396061 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bc3f214f-b2b1-4d9a-ae15-1ba1292f8b97 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:40.403790 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-77d61e61-db22-4e35-8904-96b88426f172 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:40.405085 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-77d61e61-db22-4e35-8904-96b88426f172 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:40.423589 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc3f214f-b2b1-4d9a-ae15-1ba1292f8b97 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:40.424078 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bc3f214f-b2b1-4d9a-ae15-1ba1292f8b97 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:40.425469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-77d61e61-db22-4e35-8904-96b88426f172 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:40.427198 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-77d61e61-db22-4e35-8904-96b88426f172 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:40.428602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-77d61e61-db22-4e35-8904-96b88426f172 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:40.429035 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-77d61e61-db22-4e35-8904-96b88426f172 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:40.458027 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bc3f214f-b2b1-4d9a-ae15-1ba1292f8b97 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Going to try to stop instance {{(pid=117788) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 07 07:23:40.517056 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bc3f214f-b2b1-4d9a-ae15-1ba1292f8b97 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/action" status: 202 len: 0 microversion: 2.1 time: 0.124997 Jul 07 07:23:40.518437 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 200/405] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:23:40 2022] POST /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:23:40.524974 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-227fa558-7341-4073-9899-8602dc299db4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Action: 'create', calling method: .version_select at 0x7fccfa31a310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-390493094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2EKmGEyHCpd4S5Gqa9Ivgr//jQhzF1xuw7jNLBr0LpiSF/Hf6a55WKM5aygOBjNoFsCrLUXh+5PL9IaUnveBMc7AK2QCO++ISDUZD0WulBQghNaRqNFZmKcN85k07O8Q=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:40.539776 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-227fa558-7341-4073-9899-8602dc299db4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Getting quotas for project e976a7167fc84b0ca11b4d0d1effcff3. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:23:40.544336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-227fa558-7341-4073-9899-8602dc299db4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Getting quotas for user cee7676762a04042a599439058ba90ad and project e976a7167fc84b0ca11b4d0d1effcff3. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:23:40.569330 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-227fa558-7341-4073-9899-8602dc299db4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049330 Jul 07 07:23:40.570506 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 201/406] 10.222.0.62 () {60 vars in 1158 bytes} [Thu Jul 7 07:23:40 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:23:40.575138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-134133f9-a235-429e-86e8-3f954e94dcc8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:40.575872 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-134133f9-a235-429e-86e8-3f954e94dcc8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:40.582827 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-134133f9-a235-429e-86e8-3f954e94dcc8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:40.583410 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-134133f9-a235-429e-86e8-3f954e94dcc8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:40.584024 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-134133f9-a235-429e-86e8-3f954e94dcc8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:40.584455 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-134133f9-a235-429e-86e8-3f954e94dcc8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:40.608455 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-77d61e61-db22-4e35-8904-96b88426f172 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:40.618186 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-77d61e61-db22-4e35-8904-96b88426f172 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:40.619724 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-77d61e61-db22-4e35-8904-96b88426f172 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:40.620902 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-77d61e61-db22-4e35-8904-96b88426f172 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.222140 Jul 07 07:23:40.621794 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 206/407] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:40 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:23:40.626634 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1749636641", "imageRef": "334ee997-8010-4f0d-8a5f-758b90e1f3c1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-390493094", "networks": [{"uuid": "fb66cfe5-7c0d-4720-b4f8-16c23292087e"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:40.635344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:40.679713 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] validate_networks() for [('fb66cfe5-7c0d-4720-b4f8-16c23292087e', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:23:40.811032 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-134133f9-a235-429e-86e8-3f954e94dcc8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:40.821955 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-134133f9-a235-429e-86e8-3f954e94dcc8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.249941 Jul 07 07:23:40.822284 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 202/408] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:40 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:41.084876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-24ecc89b-38d8-4f5e-9344-d05eebc67630 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:41.085419 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-24ecc89b-38d8-4f5e-9344-d05eebc67630 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:41.092345 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-24ecc89b-38d8-4f5e-9344-d05eebc67630 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:41.092796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-24ecc89b-38d8-4f5e-9344-d05eebc67630 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:41.093730 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-24ecc89b-38d8-4f5e-9344-d05eebc67630 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:41.094196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-24ecc89b-38d8-4f5e-9344-d05eebc67630 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:41.124389 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:23:41.124924 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:23:41.125414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:23:41.125945 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:23:41.126256 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:23:41.135880 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:41.136332 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:41.137257 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:41.137623 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:41.156366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Getting quotas for project e976a7167fc84b0ca11b4d0d1effcff3. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:23:41.162173 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Getting quotas for user cee7676762a04042a599439058ba90ad and project e976a7167fc84b0ca11b4d0d1effcff3. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:23:41.177317 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:23:41.179562 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='334ee997-8010-4f0d-8a5f-758b90e1f3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:23:41.237368 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-080cfc59-5a73-400d-8c40-646ba7348b40 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614169 Jul 07 07:23:41.238216 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 207/409] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:23:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:23:41.249305 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7319ddea-58ad-423a-80ed-e19ec3571119 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:41.250255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7319ddea-58ad-423a-80ed-e19ec3571119 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:41.251045 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-24ecc89b-38d8-4f5e-9344-d05eebc67630 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:41.268730 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-24ecc89b-38d8-4f5e-9344-d05eebc67630 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.187824 Jul 07 07:23:41.269560 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 203/410] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:41 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:41.316576 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7319ddea-58ad-423a-80ed-e19ec3571119 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:41.328283 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7319ddea-58ad-423a-80ed-e19ec3571119 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1258 microversion: 2.1 time: 0.083760 Jul 07 07:23:41.329612 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 208/411] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:41 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:41.639877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-34d56439-446f-4822-8d06-489e1d1c77f0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:41.640424 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-34d56439-446f-4822-8d06-489e1d1c77f0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:41.646917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34d56439-446f-4822-8d06-489e1d1c77f0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:41.647363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34d56439-446f-4822-8d06-489e1d1c77f0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:41.648246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34d56439-446f-4822-8d06-489e1d1c77f0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:41.648679 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34d56439-446f-4822-8d06-489e1d1c77f0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:41.785104 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-34d56439-446f-4822-8d06-489e1d1c77f0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:41.799029 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-34d56439-446f-4822-8d06-489e1d1c77f0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:41.801686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-34d56439-446f-4822-8d06-489e1d1c77f0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:41.803771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-34d56439-446f-4822-8d06-489e1d1c77f0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.167639 Jul 07 07:23:41.805270 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 204/412] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:41 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:41.839308 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c35ddddc-c844-4920-8a63-851c8b10d35f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:41.839924 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c35ddddc-c844-4920-8a63-851c8b10d35f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:41.846638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c35ddddc-c844-4920-8a63-851c8b10d35f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:41.847101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c35ddddc-c844-4920-8a63-851c8b10d35f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:41.847960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c35ddddc-c844-4920-8a63-851c8b10d35f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:41.848398 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c35ddddc-c844-4920-8a63-851c8b10d35f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:41.993483 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c35ddddc-c844-4920-8a63-851c8b10d35f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:42.001355 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c35ddddc-c844-4920-8a63-851c8b10d35f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.165963 Jul 07 07:23:42.001937 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 209/413] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:41 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:42.286860 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-77bcedf8-5dd2-48cd-950c-7d9b3d938d31 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:42.287350 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-77bcedf8-5dd2-48cd-950c-7d9b3d938d31 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:42.295958 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-77bcedf8-5dd2-48cd-950c-7d9b3d938d31 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:42.296517 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-77bcedf8-5dd2-48cd-950c-7d9b3d938d31 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:42.297681 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-77bcedf8-5dd2-48cd-950c-7d9b3d938d31 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:42.298195 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-77bcedf8-5dd2-48cd-950c-7d9b3d938d31 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:42.347129 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c4cea67d-3d54-4e9a-a7ce-e774124647bb tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:42.347850 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c4cea67d-3d54-4e9a-a7ce-e774124647bb tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:42.354260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c4cea67d-3d54-4e9a-a7ce-e774124647bb tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:42.354718 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c4cea67d-3d54-4e9a-a7ce-e774124647bb tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:42.356092 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c4cea67d-3d54-4e9a-a7ce-e774124647bb tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:42.356092 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c4cea67d-3d54-4e9a-a7ce-e774124647bb tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:42.433499 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c4cea67d-3d54-4e9a-a7ce-e774124647bb tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:42.442752 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c4cea67d-3d54-4e9a-a7ce-e774124647bb tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1310 microversion: 2.1 time: 0.099641 Jul 07 07:23:42.443725 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 210/414] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:42 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:42.471380 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-77bcedf8-5dd2-48cd-950c-7d9b3d938d31 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:42.479233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-77bcedf8-5dd2-48cd-950c-7d9b3d938d31 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.196634 Jul 07 07:23:42.479845 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 205/415] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:42 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:42.826556 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-db5f24e3-6733-46c6-a048-09f276edc00e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:42.827166 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-db5f24e3-6733-46c6-a048-09f276edc00e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:42.834498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-db5f24e3-6733-46c6-a048-09f276edc00e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:42.835080 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-db5f24e3-6733-46c6-a048-09f276edc00e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:42.835904 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-db5f24e3-6733-46c6-a048-09f276edc00e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:42.836332 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-db5f24e3-6733-46c6-a048-09f276edc00e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:42.996236 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-db5f24e3-6733-46c6-a048-09f276edc00e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:43.006999 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-db5f24e3-6733-46c6-a048-09f276edc00e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:43.008822 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-db5f24e3-6733-46c6-a048-09f276edc00e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:43.010052 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-db5f24e3-6733-46c6-a048-09f276edc00e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.187645 Jul 07 07:23:43.010608 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 211/416] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:42 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:43.022226 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4ee7e303-0669-49be-a14a-9610fccdef93 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:43.022226 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4ee7e303-0669-49be-a14a-9610fccdef93 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:43.035198 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ee7e303-0669-49be-a14a-9610fccdef93 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:43.035655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ee7e303-0669-49be-a14a-9610fccdef93 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:43.036540 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ee7e303-0669-49be-a14a-9610fccdef93 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:43.036978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ee7e303-0669-49be-a14a-9610fccdef93 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:43.061115 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:43.213262 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4ee7e303-0669-49be-a14a-9610fccdef93 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:43.222543 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4ee7e303-0669-49be-a14a-9610fccdef93 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.205667 Jul 07 07:23:43.225066 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 206/417] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:43 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:43.461701 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fdaca851-01e2-4249-af73-3ef142d94e52 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:43.465362 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fdaca851-01e2-4249-af73-3ef142d94e52 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:43.483328 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdaca851-01e2-4249-af73-3ef142d94e52 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:43.484005 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdaca851-01e2-4249-af73-3ef142d94e52 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:43.496493 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fba00457-b9ce-410c-b09e-1c499d64212b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:43.498309 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdaca851-01e2-4249-af73-3ef142d94e52 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:43.498860 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fba00457-b9ce-410c-b09e-1c499d64212b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:43.499012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdaca851-01e2-4249-af73-3ef142d94e52 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:43.528140 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fba00457-b9ce-410c-b09e-1c499d64212b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:43.528604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fba00457-b9ce-410c-b09e-1c499d64212b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:43.529642 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fba00457-b9ce-410c-b09e-1c499d64212b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:43.530200 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fba00457-b9ce-410c-b09e-1c499d64212b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:43.867526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fdaca851-01e2-4249-af73-3ef142d94e52 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:43.890581 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fdaca851-01e2-4249-af73-3ef142d94e52 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.433792 Jul 07 07:23:43.892724 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 212/418] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:43 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:43.912419 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fba00457-b9ce-410c-b09e-1c499d64212b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:43.915931 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-4b451efd-649b-4ed8-8ce5-c1513a341032 req-0ceb605a-ca82-4e15-a540-f0506d196a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c", "name": "network-vif-plugged", "status": "completed", "tag": "7d78694f-a735-488f-84c8-ca44f4d7aba7"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:43.924262 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fba00457-b9ce-410c-b09e-1c499d64212b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.431395 Jul 07 07:23:43.925454 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 207/419] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:43 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:43.933638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-4b451efd-649b-4ed8-8ce5-c1513a341032 req-0ceb605a-ca82-4e15-a540-f0506d196a40 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:43.943417 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-4b451efd-649b-4ed8-8ce5-c1513a341032 req-0ceb605a-ca82-4e15-a540-f0506d196a40 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:43.972264 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-4b451efd-649b-4ed8-8ce5-c1513a341032 req-0ceb605a-ca82-4e15-a540-f0506d196a40 service nova] Creating event network-vif-plugged:7d78694f-a735-488f-84c8-ca44f4d7aba7 for instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c on hv-cinder-82660 Jul 07 07:23:43.984988 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-4b451efd-649b-4ed8-8ce5-c1513a341032 req-0ceb605a-ca82-4e15-a540-f0506d196a40 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090483 Jul 07 07:23:43.985697 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 213/420] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:23:44.032811 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a63756f8-54fe-466e-9ee5-fbd0c244fd7c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:44.034260 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a63756f8-54fe-466e-9ee5-fbd0c244fd7c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:44.041861 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a63756f8-54fe-466e-9ee5-fbd0c244fd7c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:44.042572 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a63756f8-54fe-466e-9ee5-fbd0c244fd7c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:44.043530 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a63756f8-54fe-466e-9ee5-fbd0c244fd7c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:44.043968 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a63756f8-54fe-466e-9ee5-fbd0c244fd7c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:44.234655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a63756f8-54fe-466e-9ee5-fbd0c244fd7c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:44.242652 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0469e417-a0ce-4ea2-a61e-34d349b91d27 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:44.243362 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0469e417-a0ce-4ea2-a61e-34d349b91d27 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:44.246870 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a63756f8-54fe-466e-9ee5-fbd0c244fd7c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:44.249045 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a63756f8-54fe-466e-9ee5-fbd0c244fd7c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:44.250333 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0469e417-a0ce-4ea2-a61e-34d349b91d27 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:44.250459 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a63756f8-54fe-466e-9ee5-fbd0c244fd7c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.223260 Jul 07 07:23:44.250783 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0469e417-a0ce-4ea2-a61e-34d349b91d27 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:44.253266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 208/421] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:44 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:44.253429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0469e417-a0ce-4ea2-a61e-34d349b91d27 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:44.253429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0469e417-a0ce-4ea2-a61e-34d349b91d27 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:44.446274 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0469e417-a0ce-4ea2-a61e-34d349b91d27 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:44.455028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0469e417-a0ce-4ea2-a61e-34d349b91d27 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.216616 Jul 07 07:23:44.456263 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 214/422] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:44 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:44.911190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-020535f9-12c0-4382-b9b7-53263c865e5a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:44.912200 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-020535f9-12c0-4382-b9b7-53263c865e5a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:44.918921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-020535f9-12c0-4382-b9b7-53263c865e5a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:44.919594 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-020535f9-12c0-4382-b9b7-53263c865e5a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:44.920568 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-020535f9-12c0-4382-b9b7-53263c865e5a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:44.921151 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-020535f9-12c0-4382-b9b7-53263c865e5a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:44.942606 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-338737d5-ed32-4faf-ae7b-3422b253010f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:44.943434 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-338737d5-ed32-4faf-ae7b-3422b253010f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:44.951282 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-338737d5-ed32-4faf-ae7b-3422b253010f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:44.952137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-338737d5-ed32-4faf-ae7b-3422b253010f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:44.953160 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-338737d5-ed32-4faf-ae7b-3422b253010f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:44.953954 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-338737d5-ed32-4faf-ae7b-3422b253010f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:45.141134 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-020535f9-12c0-4382-b9b7-53263c865e5a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:45.146388 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-338737d5-ed32-4faf-ae7b-3422b253010f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:45.155749 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-020535f9-12c0-4382-b9b7-53263c865e5a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.248563 Jul 07 07:23:45.156485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 209/423] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:44 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:45.156866 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-338737d5-ed32-4faf-ae7b-3422b253010f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.217793 Jul 07 07:23:45.158161 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 215/424] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:44 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:45.271295 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-81608955-c80a-4385-83ac-a3e14de59a3a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:45.272442 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-81608955-c80a-4385-83ac-a3e14de59a3a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:45.282885 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-81608955-c80a-4385-83ac-a3e14de59a3a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:45.283562 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-81608955-c80a-4385-83ac-a3e14de59a3a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:45.285146 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-81608955-c80a-4385-83ac-a3e14de59a3a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:45.285778 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-81608955-c80a-4385-83ac-a3e14de59a3a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:45.444657 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-81608955-c80a-4385-83ac-a3e14de59a3a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:45.453506 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-81608955-c80a-4385-83ac-a3e14de59a3a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:45.455001 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-81608955-c80a-4385-83ac-a3e14de59a3a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:45.456147 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-81608955-c80a-4385-83ac-a3e14de59a3a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.190080 Jul 07 07:23:45.456740 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 210/425] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:45 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:23:45.472606 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8821460d-5f43-4e74-9362-8e46b54218e6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:45.473236 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8821460d-5f43-4e74-9362-8e46b54218e6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:45.479302 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8821460d-5f43-4e74-9362-8e46b54218e6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:45.479746 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8821460d-5f43-4e74-9362-8e46b54218e6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:45.480502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8821460d-5f43-4e74-9362-8e46b54218e6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:45.480926 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8821460d-5f43-4e74-9362-8e46b54218e6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:45.643690 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8821460d-5f43-4e74-9362-8e46b54218e6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:45.652228 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8821460d-5f43-4e74-9362-8e46b54218e6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.183562 Jul 07 07:23:45.652892 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 216/426] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:45 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:45.999852 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-570e4340-d11c-4f22-a8c0-526d148cb48b req-3136e6dd-ed9a-46ef-ae47-23816b826d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83944e7d-3750-4747-92ae-6a1f735c79fc", "name": "network-vif-plugged", "status": "completed", "tag": "19dfde08-41d9-41e9-b31b-405a6dc8008a"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:46.008269 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-570e4340-d11c-4f22-a8c0-526d148cb48b req-3136e6dd-ed9a-46ef-ae47-23816b826d5b service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:46.008711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-570e4340-d11c-4f22-a8c0-526d148cb48b req-3136e6dd-ed9a-46ef-ae47-23816b826d5b service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:46.019506 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-570e4340-d11c-4f22-a8c0-526d148cb48b req-3136e6dd-ed9a-46ef-ae47-23816b826d5b service nova] Creating event network-vif-plugged:19dfde08-41d9-41e9-b31b-405a6dc8008a for instance 83944e7d-3750-4747-92ae-6a1f735c79fc on hv-cinder-82660 Jul 07 07:23:46.024559 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-570e4340-d11c-4f22-a8c0-526d148cb48b req-3136e6dd-ed9a-46ef-ae47-23816b826d5b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028358 Jul 07 07:23:46.025475 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 211/427] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:23:46.181166 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e4b5ad16-98dc-4d2f-b495-19f948cec346 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:46.182557 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aa8c6809-4a47-4080-8d67-542464decd41 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:46.183218 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aa8c6809-4a47-4080-8d67-542464decd41 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:46.184521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e4b5ad16-98dc-4d2f-b495-19f948cec346 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:46.200085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4b5ad16-98dc-4d2f-b495-19f948cec346 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:46.200536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4b5ad16-98dc-4d2f-b495-19f948cec346 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:46.201797 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa8c6809-4a47-4080-8d67-542464decd41 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:46.202508 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa8c6809-4a47-4080-8d67-542464decd41 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:46.203359 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa8c6809-4a47-4080-8d67-542464decd41 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:46.203812 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa8c6809-4a47-4080-8d67-542464decd41 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:46.205073 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4b5ad16-98dc-4d2f-b495-19f948cec346 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:46.205639 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4b5ad16-98dc-4d2f-b495-19f948cec346 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:46.415169 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aa8c6809-4a47-4080-8d67-542464decd41 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:46.424545 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aa8c6809-4a47-4080-8d67-542464decd41 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.254050 Jul 07 07:23:46.425476 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 217/428] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:46 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:46.434817 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4b5ad16-98dc-4d2f-b495-19f948cec346 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:46.442835 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e4b5ad16-98dc-4d2f-b495-19f948cec346 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.271094 Jul 07 07:23:46.443434 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 212/429] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:46 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:46.479052 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c3417ec6-cb27-4108-8be3-5eb74c48f77b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:46.479968 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c3417ec6-cb27-4108-8be3-5eb74c48f77b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:46.491314 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3417ec6-cb27-4108-8be3-5eb74c48f77b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:46.492010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3417ec6-cb27-4108-8be3-5eb74c48f77b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:46.493123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3417ec6-cb27-4108-8be3-5eb74c48f77b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:46.497707 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3417ec6-cb27-4108-8be3-5eb74c48f77b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:46.671208 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c3417ec6-cb27-4108-8be3-5eb74c48f77b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:46.678517 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9a1dda09-8fc1-4db6-bff7-f75e222dfde9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:46.679118 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9a1dda09-8fc1-4db6-bff7-f75e222dfde9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:46.693829 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c3417ec6-cb27-4108-8be3-5eb74c48f77b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:46.694310 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a1dda09-8fc1-4db6-bff7-f75e222dfde9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:46.694796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a1dda09-8fc1-4db6-bff7-f75e222dfde9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:46.696414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a1dda09-8fc1-4db6-bff7-f75e222dfde9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:46.697772 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a1dda09-8fc1-4db6-bff7-f75e222dfde9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:46.701384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c3417ec6-cb27-4108-8be3-5eb74c48f77b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:46.702743 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c3417ec6-cb27-4108-8be3-5eb74c48f77b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.227773 Jul 07 07:23:46.703849 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 218/430] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:46 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:46.854837 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9a1dda09-8fc1-4db6-bff7-f75e222dfde9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:46.868039 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9a1dda09-8fc1-4db6-bff7-f75e222dfde9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.200067 Jul 07 07:23:46.875830 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 213/431] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:46 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:47.443234 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e42ded58-3a20-4f60-b6a2-e2db347e27e9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:47.444671 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e42ded58-3a20-4f60-b6a2-e2db347e27e9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:47.452005 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e42ded58-3a20-4f60-b6a2-e2db347e27e9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:47.452462 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e42ded58-3a20-4f60-b6a2-e2db347e27e9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:47.455216 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e42ded58-3a20-4f60-b6a2-e2db347e27e9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:47.455216 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e42ded58-3a20-4f60-b6a2-e2db347e27e9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:47.460235 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f7e27a0-f0ec-4fa8-b629-f2b4cfc44985 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:47.460819 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f7e27a0-f0ec-4fa8-b629-f2b4cfc44985 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:47.467214 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f7e27a0-f0ec-4fa8-b629-f2b4cfc44985 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:47.467651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f7e27a0-f0ec-4fa8-b629-f2b4cfc44985 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:47.468416 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f7e27a0-f0ec-4fa8-b629-f2b4cfc44985 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:47.468843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f7e27a0-f0ec-4fa8-b629-f2b4cfc44985 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:47.677449 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e42ded58-3a20-4f60-b6a2-e2db347e27e9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:47.681006 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f7e27a0-f0ec-4fa8-b629-f2b4cfc44985 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:47.688436 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e42ded58-3a20-4f60-b6a2-e2db347e27e9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.249003 Jul 07 07:23:47.689047 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 219/432] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:47 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:47.690654 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f7e27a0-f0ec-4fa8-b629-f2b4cfc44985 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.234115 Jul 07 07:23:47.691233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 214/433] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:47 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:47.722514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-10751ddb-0b8c-4b33-b5b0-196e559cad21 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:47.723116 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-10751ddb-0b8c-4b33-b5b0-196e559cad21 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:47.729507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10751ddb-0b8c-4b33-b5b0-196e559cad21 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:47.729956 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10751ddb-0b8c-4b33-b5b0-196e559cad21 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:47.730752 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10751ddb-0b8c-4b33-b5b0-196e559cad21 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:47.731184 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-10751ddb-0b8c-4b33-b5b0-196e559cad21 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:47.750471 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:47.885309 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0595c7fd-f8a2-45e7-bc62-378f4e21f9a7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:47.885922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0595c7fd-f8a2-45e7-bc62-378f4e21f9a7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:47.892171 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0595c7fd-f8a2-45e7-bc62-378f4e21f9a7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:47.892859 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0595c7fd-f8a2-45e7-bc62-378f4e21f9a7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:47.893683 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0595c7fd-f8a2-45e7-bc62-378f4e21f9a7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:47.894123 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0595c7fd-f8a2-45e7-bc62-378f4e21f9a7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:47.908145 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-10751ddb-0b8c-4b33-b5b0-196e559cad21 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:47.916899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-10751ddb-0b8c-4b33-b5b0-196e559cad21 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:47.918392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-10751ddb-0b8c-4b33-b5b0-196e559cad21 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:47.919550 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-10751ddb-0b8c-4b33-b5b0-196e559cad21 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.201524 Jul 07 07:23:47.920104 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 220/434] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:47 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:48.023105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eeaaa35a-ef0f-4bfb-9bff-40c1471f8090 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:48.023767 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eeaaa35a-ef0f-4bfb-9bff-40c1471f8090 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:48.029893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eeaaa35a-ef0f-4bfb-9bff-40c1471f8090 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.030350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eeaaa35a-ef0f-4bfb-9bff-40c1471f8090 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.030730 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0595c7fd-f8a2-45e7-bc62-378f4e21f9a7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:48.031125 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eeaaa35a-ef0f-4bfb-9bff-40c1471f8090 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.031550 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eeaaa35a-ef0f-4bfb-9bff-40c1471f8090 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.038678 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0595c7fd-f8a2-45e7-bc62-378f4e21f9a7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.157654 Jul 07 07:23:48.039524 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 215/435] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:47 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:48.057432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eeaaa35a-ef0f-4bfb-9bff-40c1471f8090 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492/ips" status: 200 len: 150 microversion: 2.1 time: 0.038160 Jul 07 07:23:48.058027 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 221/436] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Jul 7 07:23:48 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:23:48.070685 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-25a8ec6e-4fea-41d7-a8e7-4e52fdf343b8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cc8958a-8bf9-4d14-880f-bb692be31594"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:48.071815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-25a8ec6e-4fea-41d7-a8e7-4e52fdf343b8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:48.078363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25a8ec6e-4fea-41d7-a8e7-4e52fdf343b8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.078819 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25a8ec6e-4fea-41d7-a8e7-4e52fdf343b8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.079603 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25a8ec6e-4fea-41d7-a8e7-4e52fdf343b8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.080036 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-25a8ec6e-4fea-41d7-a8e7-4e52fdf343b8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.170896 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-25a8ec6e-4fea-41d7-a8e7-4e52fdf343b8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Invalid volume: volume 2cc8958a-8bf9-4d14-880f-bb692be31594 is already attached to instances: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-25a8ec6e-4fea-41d7-a8e7-4e52fdf343b8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492/os-volume_attachments HTTP/1.1 Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 74 Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:23:48.172877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {"volumeAttachment": {"volumeId": "2cc8958a-8bf9-4d14-880f-bb692be31594"}} Jul 07 07:23:48.174271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Invalid volume: volume 2cc8958a-8bf9-4d14-880f-bb692be31594 is already attached to instances: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'server_id': 'f8e7489d-0481-4cfe-8e7d-4d9bd447f492', 'body': {'volumeAttachment': {'volumeId': '2cc8958a-8bf9-4d14-880f-bb692be31594'}}} Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2cc8958a-8bf9-4d14-880f-bb692be31594 is already attached to instances: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:23:48.175009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2cc8958a-8bf9-4d14-880f-bb692be31594 is already attached to instances: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:23:48.176536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:23:48.178089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:23:48.178089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:23:48.178089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:23:48.178089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2cc8958a-8bf9-4d14-880f-bb692be31594 is already attached to instances: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c Jul 07 07:23:48.178089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:23:48.178089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-25a8ec6e-4fea-41d7-a8e7-4e52fdf343b8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 400 to user: Invalid volume: volume 2cc8958a-8bf9-4d14-880f-bb692be31594 is already attached to instances: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:23:48.178089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-25a8ec6e-4fea-41d7-a8e7-4e52fdf343b8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108018 Jul 07 07:23:48.178089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 216/437] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:23:48 2022] POST /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 07:23:48.186050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9b5485a3-c68a-48a7-a527-d7bfb0333f42 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:48.186788 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9b5485a3-c68a-48a7-a527-d7bfb0333f42 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:48.194902 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b5485a3-c68a-48a7-a527-d7bfb0333f42 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.195502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b5485a3-c68a-48a7-a527-d7bfb0333f42 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.196472 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b5485a3-c68a-48a7-a527-d7bfb0333f42 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.197046 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b5485a3-c68a-48a7-a527-d7bfb0333f42 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.224321 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9b5485a3-c68a-48a7-a527-d7bfb0333f42 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:23:48.422056 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9b5485a3-c68a-48a7-a527-d7bfb0333f42 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 204 len: 0 microversion: 2.1 time: 0.241380 Jul 07 07:23:48.423419 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 222/438] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:23:48 2022] DELETE /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 07 07:23:48.434465 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f1b8fc08-c310-41a7-a008-cb026a96c9fb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:48.435142 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f1b8fc08-c310-41a7-a008-cb026a96c9fb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:48.445303 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1b8fc08-c310-41a7-a008-cb026a96c9fb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.445781 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1b8fc08-c310-41a7-a008-cb026a96c9fb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.446559 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1b8fc08-c310-41a7-a008-cb026a96c9fb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.446990 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1b8fc08-c310-41a7-a008-cb026a96c9fb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.599018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f1b8fc08-c310-41a7-a008-cb026a96c9fb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:48.608403 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f1b8fc08-c310-41a7-a008-cb026a96c9fb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1682 microversion: 2.1 time: 0.179327 Jul 07 07:23:48.609256 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 217/439] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:48 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:48.707967 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ac62e799-c596-4db9-bd8a-e7a8709d1127 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:48.708198 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-45011d55-43c9-4078-9896-194f4c41db30 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:48.708679 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ac62e799-c596-4db9-bd8a-e7a8709d1127 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:48.708777 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-45011d55-43c9-4078-9896-194f4c41db30 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:48.716098 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac62e799-c596-4db9-bd8a-e7a8709d1127 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.716371 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45011d55-43c9-4078-9896-194f4c41db30 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.716539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac62e799-c596-4db9-bd8a-e7a8709d1127 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.717008 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45011d55-43c9-4078-9896-194f4c41db30 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.717394 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac62e799-c596-4db9-bd8a-e7a8709d1127 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.717893 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac62e799-c596-4db9-bd8a-e7a8709d1127 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.718057 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45011d55-43c9-4078-9896-194f4c41db30 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.718382 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45011d55-43c9-4078-9896-194f4c41db30 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.934732 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-45011d55-43c9-4078-9896-194f4c41db30 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:48.938664 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ac62e799-c596-4db9-bd8a-e7a8709d1127 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:48.945428 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-45011d55-43c9-4078-9896-194f4c41db30 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.241982 Jul 07 07:23:48.946354 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 223/440] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:48 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:48.948234 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ac62e799-c596-4db9-bd8a-e7a8709d1127 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.244252 Jul 07 07:23:48.951303 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-26fa2d21-3873-4fcc-a512-7d57626aada8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:48.951897 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-26fa2d21-3873-4fcc-a512-7d57626aada8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:48.958547 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 218/441] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:48 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:48.958770 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26fa2d21-3873-4fcc-a512-7d57626aada8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.959176 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26fa2d21-3873-4fcc-a512-7d57626aada8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:48.959958 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26fa2d21-3873-4fcc-a512-7d57626aada8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:48.960382 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-26fa2d21-3873-4fcc-a512-7d57626aada8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:49.059682 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-91749d8e-f8c0-473f-be0f-bfc5e406756e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:49.059682 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-91749d8e-f8c0-473f-be0f-bfc5e406756e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:49.073233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91749d8e-f8c0-473f-be0f-bfc5e406756e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:49.073812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91749d8e-f8c0-473f-be0f-bfc5e406756e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:49.074712 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91749d8e-f8c0-473f-be0f-bfc5e406756e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:49.085801 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-91749d8e-f8c0-473f-be0f-bfc5e406756e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:49.189493 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-26fa2d21-3873-4fcc-a512-7d57626aada8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:49.198496 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-26fa2d21-3873-4fcc-a512-7d57626aada8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:49.201455 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-26fa2d21-3873-4fcc-a512-7d57626aada8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:49.203025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-26fa2d21-3873-4fcc-a512-7d57626aada8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.255356 Jul 07 07:23:49.203771 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 224/442] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:48 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:49.271552 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-91749d8e-f8c0-473f-be0f-bfc5e406756e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:49.279094 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-91749d8e-f8c0-473f-be0f-bfc5e406756e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.225968 Jul 07 07:23:49.279664 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 219/443] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:49 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:49.627098 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9e07e852-d882-40ac-bcf5-05af587ea85a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:49.627804 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9e07e852-d882-40ac-bcf5-05af587ea85a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:49.634423 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e07e852-d882-40ac-bcf5-05af587ea85a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:49.634916 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e07e852-d882-40ac-bcf5-05af587ea85a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:49.635646 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e07e852-d882-40ac-bcf5-05af587ea85a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:49.636076 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9e07e852-d882-40ac-bcf5-05af587ea85a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:49.795883 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9e07e852-d882-40ac-bcf5-05af587ea85a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:49.806074 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9e07e852-d882-40ac-bcf5-05af587ea85a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1682 microversion: 2.1 time: 0.182681 Jul 07 07:23:49.806949 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 225/444] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:49 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:49.963195 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0d14a042-418f-440b-aaae-2fea77f52190 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:49.963815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0d14a042-418f-440b-aaae-2fea77f52190 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:49.965830 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f4538f1f-2da2-40cb-a009-fcd9db6ed66e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:49.967278 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f4538f1f-2da2-40cb-a009-fcd9db6ed66e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:49.971032 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d14a042-418f-440b-aaae-2fea77f52190 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:49.971479 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d14a042-418f-440b-aaae-2fea77f52190 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:49.972280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d14a042-418f-440b-aaae-2fea77f52190 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:49.972804 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d14a042-418f-440b-aaae-2fea77f52190 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:49.982141 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4538f1f-2da2-40cb-a009-fcd9db6ed66e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:49.983323 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4538f1f-2da2-40cb-a009-fcd9db6ed66e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:49.984418 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4538f1f-2da2-40cb-a009-fcd9db6ed66e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:49.985287 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4538f1f-2da2-40cb-a009-fcd9db6ed66e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:50.179069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0d14a042-418f-440b-aaae-2fea77f52190 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:50.188995 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0d14a042-418f-440b-aaae-2fea77f52190 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.229906 Jul 07 07:23:50.211001 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 220/445] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:49 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:50.211250 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f4538f1f-2da2-40cb-a009-fcd9db6ed66e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:50.213962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f4538f1f-2da2-40cb-a009-fcd9db6ed66e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.251982 Jul 07 07:23:50.217091 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 226/446] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:49 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:50.222975 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-72cd3f46-6f39-4d42-adb7-f54792d93337 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:50.224093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-72cd3f46-6f39-4d42-adb7-f54792d93337 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:50.231310 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72cd3f46-6f39-4d42-adb7-f54792d93337 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:50.231751 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72cd3f46-6f39-4d42-adb7-f54792d93337 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:50.232521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72cd3f46-6f39-4d42-adb7-f54792d93337 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:50.232946 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72cd3f46-6f39-4d42-adb7-f54792d93337 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:50.297428 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0d27d490-d013-4e67-a40f-317dfd21edf1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:50.298119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0d27d490-d013-4e67-a40f-317dfd21edf1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:50.307069 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d27d490-d013-4e67-a40f-317dfd21edf1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:50.307491 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d27d490-d013-4e67-a40f-317dfd21edf1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:50.308304 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d27d490-d013-4e67-a40f-317dfd21edf1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:50.308738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d27d490-d013-4e67-a40f-317dfd21edf1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:50.417433 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-72cd3f46-6f39-4d42-adb7-f54792d93337 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:50.426540 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-72cd3f46-6f39-4d42-adb7-f54792d93337 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:50.428068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-72cd3f46-6f39-4d42-adb7-f54792d93337 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:50.429273 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-72cd3f46-6f39-4d42-adb7-f54792d93337 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.211086 Jul 07 07:23:50.429839 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 221/447] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:50 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:23:50.486762 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0d27d490-d013-4e67-a40f-317dfd21edf1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:50.495753 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0d27d490-d013-4e67-a40f-317dfd21edf1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.202664 Jul 07 07:23:50.497267 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 227/448] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:50 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:50.824236 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-421dc83d-6cb2-4941-b33a-c80e69f0b5ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:50.824844 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-421dc83d-6cb2-4941-b33a-c80e69f0b5ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:50.826893 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=4 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:50.832732 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-421dc83d-6cb2-4941-b33a-c80e69f0b5ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:50.833179 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-421dc83d-6cb2-4941-b33a-c80e69f0b5ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:50.833978 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-421dc83d-6cb2-4941-b33a-c80e69f0b5ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:50.834404 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-421dc83d-6cb2-4941-b33a-c80e69f0b5ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:50.985855 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-421dc83d-6cb2-4941-b33a-c80e69f0b5ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:50.993777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-421dc83d-6cb2-4941-b33a-c80e69f0b5ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1682 microversion: 2.1 time: 0.173337 Jul 07 07:23:50.994610 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 222/449] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:50 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:51.219961 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b344f0f1-55dd-4227-8c20-9a96724daa53 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:51.220565 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b344f0f1-55dd-4227-8c20-9a96724daa53 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:51.224256 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:51.230770 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b344f0f1-55dd-4227-8c20-9a96724daa53 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:51.231221 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b344f0f1-55dd-4227-8c20-9a96724daa53 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:51.232048 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b344f0f1-55dd-4227-8c20-9a96724daa53 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:51.232443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b344f0f1-55dd-4227-8c20-9a96724daa53 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:51.234750 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0cf3f53e-8a66-4a96-9ae5-b135dcd4d64c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:51.235007 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0cf3f53e-8a66-4a96-9ae5-b135dcd4d64c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:51.242006 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cf3f53e-8a66-4a96-9ae5-b135dcd4d64c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:51.242456 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cf3f53e-8a66-4a96-9ae5-b135dcd4d64c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:51.243239 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cf3f53e-8a66-4a96-9ae5-b135dcd4d64c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:51.243675 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0cf3f53e-8a66-4a96-9ae5-b135dcd4d64c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:51.324483 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=8 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:51.463312 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0cf3f53e-8a66-4a96-9ae5-b135dcd4d64c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:51.466803 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:51.470052 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b344f0f1-55dd-4227-8c20-9a96724daa53 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:51.471516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0cf3f53e-8a66-4a96-9ae5-b135dcd4d64c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.241385 Jul 07 07:23:51.472129 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 223/450] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:51 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:51.477171 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b3b8833b-36ad-4190-9796-aa50aa3496c9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:51.477804 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b3b8833b-36ad-4190-9796-aa50aa3496c9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:51.478913 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b344f0f1-55dd-4227-8c20-9a96724daa53 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.263546 Jul 07 07:23:51.481373 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 228/451] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:51 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:51.484579 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3b8833b-36ad-4190-9796-aa50aa3496c9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:51.485034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3b8833b-36ad-4190-9796-aa50aa3496c9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:51.485949 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3b8833b-36ad-4190-9796-aa50aa3496c9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:51.486385 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b3b8833b-36ad-4190-9796-aa50aa3496c9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:51.514191 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6b196c2c-5c69-4830-97a5-ab03058e28bd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:51.514967 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6b196c2c-5c69-4830-97a5-ab03058e28bd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:51.524446 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b196c2c-5c69-4830-97a5-ab03058e28bd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:51.525031 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b196c2c-5c69-4830-97a5-ab03058e28bd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:51.526134 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b196c2c-5c69-4830-97a5-ab03058e28bd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:51.526675 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6b196c2c-5c69-4830-97a5-ab03058e28bd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:51.748281 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b3b8833b-36ad-4190-9796-aa50aa3496c9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:51.758157 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b3b8833b-36ad-4190-9796-aa50aa3496c9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:51.759633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b3b8833b-36ad-4190-9796-aa50aa3496c9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:51.760543 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6b196c2c-5c69-4830-97a5-ab03058e28bd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:51.760800 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b3b8833b-36ad-4190-9796-aa50aa3496c9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.287790 Jul 07 07:23:51.761398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 224/452] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:51 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:51.769170 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6b196c2c-5c69-4830-97a5-ab03058e28bd tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.259043 Jul 07 07:23:51.773255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 229/453] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:51 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:52.012560 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-161be89f-66fa-4d6b-9770-1cf1c8603afc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:52.013194 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-161be89f-66fa-4d6b-9770-1cf1c8603afc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:52.020336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-161be89f-66fa-4d6b-9770-1cf1c8603afc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:52.020793 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-161be89f-66fa-4d6b-9770-1cf1c8603afc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:52.021725 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-161be89f-66fa-4d6b-9770-1cf1c8603afc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:52.022165 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-161be89f-66fa-4d6b-9770-1cf1c8603afc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:52.163910 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-161be89f-66fa-4d6b-9770-1cf1c8603afc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:52.172886 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-161be89f-66fa-4d6b-9770-1cf1c8603afc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1682 microversion: 2.1 time: 0.164266 Jul 07 07:23:52.173716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 225/454] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:52 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:52.488517 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2c55563c-7d8f-42cd-a767-11b3c95a7706 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:52.490929 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2c55563c-7d8f-42cd-a767-11b3c95a7706 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:52.497004 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9a74df33-1a7a-40fe-8fdd-66531d24bbf0 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:52.498466 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9a74df33-1a7a-40fe-8fdd-66531d24bbf0 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:52.499502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c55563c-7d8f-42cd-a767-11b3c95a7706 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:52.499968 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c55563c-7d8f-42cd-a767-11b3c95a7706 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:52.500905 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c55563c-7d8f-42cd-a767-11b3c95a7706 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:52.501195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c55563c-7d8f-42cd-a767-11b3c95a7706 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:52.506954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a74df33-1a7a-40fe-8fdd-66531d24bbf0 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:52.508082 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a74df33-1a7a-40fe-8fdd-66531d24bbf0 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:52.509123 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a74df33-1a7a-40fe-8fdd-66531d24bbf0 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:52.509805 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a74df33-1a7a-40fe-8fdd-66531d24bbf0 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:52.726048 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2c55563c-7d8f-42cd-a767-11b3c95a7706 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:52.728607 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9a74df33-1a7a-40fe-8fdd-66531d24bbf0 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:52.736320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2c55563c-7d8f-42cd-a767-11b3c95a7706 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.251968 Jul 07 07:23:52.736543 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9a74df33-1a7a-40fe-8fdd-66531d24bbf0 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.243823 Jul 07 07:23:52.736909 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 230/455] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:52 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:52.737022 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 226/456] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:52 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:52.781768 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-572d174a-9733-4701-9dd3-e1e00a7460dc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:52.782897 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-572d174a-9733-4701-9dd3-e1e00a7460dc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:52.792565 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0ca80ded-500e-437a-9d8a-0359c0765af0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:52.793800 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-572d174a-9733-4701-9dd3-e1e00a7460dc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:52.794280 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-572d174a-9733-4701-9dd3-e1e00a7460dc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:52.794728 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0ca80ded-500e-437a-9d8a-0359c0765af0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:52.795094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-572d174a-9733-4701-9dd3-e1e00a7460dc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:52.795530 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-572d174a-9733-4701-9dd3-e1e00a7460dc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:52.803074 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ca80ded-500e-437a-9d8a-0359c0765af0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:52.803557 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ca80ded-500e-437a-9d8a-0359c0765af0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:52.804349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ca80ded-500e-437a-9d8a-0359c0765af0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:52.804803 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ca80ded-500e-437a-9d8a-0359c0765af0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:53.011998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-572d174a-9733-4701-9dd3-e1e00a7460dc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:53.017057 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0ca80ded-500e-437a-9d8a-0359c0765af0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:53.022099 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-572d174a-9733-4701-9dd3-e1e00a7460dc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:53.023629 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-572d174a-9733-4701-9dd3-e1e00a7460dc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:53.024816 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-572d174a-9733-4701-9dd3-e1e00a7460dc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.248804 Jul 07 07:23:53.025402 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 231/457] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:52 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:53.026018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0ca80ded-500e-437a-9d8a-0359c0765af0 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.240907 Jul 07 07:23:53.026687 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 227/458] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:52 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:53.191732 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f10fd4c0-04c2-4987-8d16-d935193b68cc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:53.192251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f10fd4c0-04c2-4987-8d16-d935193b68cc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:53.199112 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f10fd4c0-04c2-4987-8d16-d935193b68cc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:53.199560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f10fd4c0-04c2-4987-8d16-d935193b68cc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:53.200324 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f10fd4c0-04c2-4987-8d16-d935193b68cc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:53.200755 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f10fd4c0-04c2-4987-8d16-d935193b68cc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:53.347106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f10fd4c0-04c2-4987-8d16-d935193b68cc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:53.356405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f10fd4c0-04c2-4987-8d16-d935193b68cc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1682 microversion: 2.1 time: 0.168764 Jul 07 07:23:53.357247 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 232/459] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:53 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:53.758351 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0ca67607-ec2f-4fa3-a8d2-6b33a8dd48ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:53.758981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0ca67607-ec2f-4fa3-a8d2-6b33a8dd48ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:53.759232 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8689ec6c-edc1-454b-bfe7-dab91d4a1699 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:53.759789 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8689ec6c-edc1-454b-bfe7-dab91d4a1699 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:53.767883 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8689ec6c-edc1-454b-bfe7-dab91d4a1699 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:53.768325 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8689ec6c-edc1-454b-bfe7-dab91d4a1699 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:53.770424 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8689ec6c-edc1-454b-bfe7-dab91d4a1699 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:53.770853 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8689ec6c-edc1-454b-bfe7-dab91d4a1699 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:53.771262 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ca67607-ec2f-4fa3-a8d2-6b33a8dd48ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:53.771719 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ca67607-ec2f-4fa3-a8d2-6b33a8dd48ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:53.772512 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ca67607-ec2f-4fa3-a8d2-6b33a8dd48ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:53.772957 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ca67607-ec2f-4fa3-a8d2-6b33a8dd48ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:53.995766 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8689ec6c-edc1-454b-bfe7-dab91d4a1699 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:53.999826 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0ca67607-ec2f-4fa3-a8d2-6b33a8dd48ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:54.009626 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8689ec6c-edc1-454b-bfe7-dab91d4a1699 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.259678 Jul 07 07:23:54.010592 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 228/460] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:53 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:54.015922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-7a2e8d43-bfcf-418e-867f-985dbdff0914 req-f3776a3c-2258-4c10-a4ca-0921eee5d068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e219f102-9056-42d4-86fd-4a0f8348d041", "tag": "93dad3d5-bbb3-4950-91cc-7f4d0c71fe54"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:54.024973 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7a2e8d43-bfcf-418e-867f-985dbdff0914 req-f3776a3c-2258-4c10-a4ca-0921eee5d068 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:54.026307 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7a2e8d43-bfcf-418e-867f-985dbdff0914 req-f3776a3c-2258-4c10-a4ca-0921eee5d068 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:54.027659 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0ca67607-ec2f-4fa3-a8d2-6b33a8dd48ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.273192 Jul 07 07:23:54.028512 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 233/461] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:53 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:54.039137 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-7a2e8d43-bfcf-418e-867f-985dbdff0914 req-f3776a3c-2258-4c10-a4ca-0921eee5d068 service nova] Creating event network-changed:93dad3d5-bbb3-4950-91cc-7f4d0c71fe54 for instance e219f102-9056-42d4-86fd-4a0f8348d041 on hv-cinder-82660 Jul 07 07:23:54.045275 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-001e1646-37cb-4d97-b4cb-c7d236ad8819 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:54.045970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-001e1646-37cb-4d97-b4cb-c7d236ad8819 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:54.046412 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-7a2e8d43-bfcf-418e-867f-985dbdff0914 req-f3776a3c-2258-4c10-a4ca-0921eee5d068 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034324 Jul 07 07:23:54.047326 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 229/462] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:23:54.052969 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-001e1646-37cb-4d97-b4cb-c7d236ad8819 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:54.053154 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-34e6d33d-5271-4bda-aed0-d90ea59ebca4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:54.053533 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-001e1646-37cb-4d97-b4cb-c7d236ad8819 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:54.054207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-34e6d33d-5271-4bda-aed0-d90ea59ebca4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:54.054365 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-001e1646-37cb-4d97-b4cb-c7d236ad8819 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:54.054744 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-001e1646-37cb-4d97-b4cb-c7d236ad8819 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:54.063210 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34e6d33d-5271-4bda-aed0-d90ea59ebca4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:54.063974 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34e6d33d-5271-4bda-aed0-d90ea59ebca4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:54.064969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34e6d33d-5271-4bda-aed0-d90ea59ebca4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:54.065926 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-34e6d33d-5271-4bda-aed0-d90ea59ebca4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:54.269610 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-001e1646-37cb-4d97-b4cb-c7d236ad8819 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:54.277248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-34e6d33d-5271-4bda-aed0-d90ea59ebca4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:54.281277 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-001e1646-37cb-4d97-b4cb-c7d236ad8819 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:54.282899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-001e1646-37cb-4d97-b4cb-c7d236ad8819 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:54.284206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-001e1646-37cb-4d97-b4cb-c7d236ad8819 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.244588 Jul 07 07:23:54.285483 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 234/463] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:54 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:54.285639 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-34e6d33d-5271-4bda-aed0-d90ea59ebca4 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1676 microversion: 2.1 time: 0.236707 Jul 07 07:23:54.286191 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 230/464] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:54 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1676 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:54.374503 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-55ad6ace-d064-4562-b577-e5d9449d4881 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:54.375199 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-55ad6ace-d064-4562-b577-e5d9449d4881 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:54.382211 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55ad6ace-d064-4562-b577-e5d9449d4881 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:54.382665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55ad6ace-d064-4562-b577-e5d9449d4881 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:54.383439 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55ad6ace-d064-4562-b577-e5d9449d4881 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:54.383867 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55ad6ace-d064-4562-b577-e5d9449d4881 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:54.525607 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-55ad6ace-d064-4562-b577-e5d9449d4881 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:54.529077 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:54.534550 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-55ad6ace-d064-4562-b577-e5d9449d4881 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1682 microversion: 2.1 time: 0.164233 Jul 07 07:23:54.535130 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 235/465] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:54 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:55.027738 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-df36d8f6-af15-45a4-806f-04e92ea9e889 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:55.028358 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-df36d8f6-af15-45a4-806f-04e92ea9e889 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:55.034785 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df36d8f6-af15-45a4-806f-04e92ea9e889 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.035235 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df36d8f6-af15-45a4-806f-04e92ea9e889 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.036005 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df36d8f6-af15-45a4-806f-04e92ea9e889 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.036440 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-df36d8f6-af15-45a4-806f-04e92ea9e889 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.044380 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ecdc645a-68c6-4847-9532-d2ac22e68ee6 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:55.045003 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ecdc645a-68c6-4847-9532-d2ac22e68ee6 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:55.052857 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ecdc645a-68c6-4847-9532-d2ac22e68ee6 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.053312 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ecdc645a-68c6-4847-9532-d2ac22e68ee6 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.054123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ecdc645a-68c6-4847-9532-d2ac22e68ee6 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.054558 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ecdc645a-68c6-4847-9532-d2ac22e68ee6 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.246206 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-df36d8f6-af15-45a4-806f-04e92ea9e889 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:55.250452 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ecdc645a-68c6-4847-9532-d2ac22e68ee6 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:55.254539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-df36d8f6-af15-45a4-806f-04e92ea9e889 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.230824 Jul 07 07:23:55.255131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 231/466] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:55 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:55.259115 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ecdc645a-68c6-4847-9532-d2ac22e68ee6 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.218914 Jul 07 07:23:55.259658 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 236/467] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:55 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:55.302488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e33ac2bc-632e-4c5b-8e34-09acccc114ae tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:55.302724 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f4864021-9248-4d50-8b26-913bfb0f8391 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:55.303081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e33ac2bc-632e-4c5b-8e34-09acccc114ae tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:55.303570 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f4864021-9248-4d50-8b26-913bfb0f8391 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:55.310016 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e33ac2bc-632e-4c5b-8e34-09acccc114ae tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.310862 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e33ac2bc-632e-4c5b-8e34-09acccc114ae tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.311780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e33ac2bc-632e-4c5b-8e34-09acccc114ae tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.312308 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e33ac2bc-632e-4c5b-8e34-09acccc114ae tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.312611 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4864021-9248-4d50-8b26-913bfb0f8391 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.313096 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4864021-9248-4d50-8b26-913bfb0f8391 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.314112 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4864021-9248-4d50-8b26-913bfb0f8391 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.314614 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4864021-9248-4d50-8b26-913bfb0f8391 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.514204 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e33ac2bc-632e-4c5b-8e34-09acccc114ae tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:55.517208 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f4864021-9248-4d50-8b26-913bfb0f8391 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:55.523686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e33ac2bc-632e-4c5b-8e34-09acccc114ae tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:55.525243 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e33ac2bc-632e-4c5b-8e34-09acccc114ae tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:55.525640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f4864021-9248-4d50-8b26-913bfb0f8391 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1653 microversion: 2.1 time: 0.226919 Jul 07 07:23:55.526216 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 237/468] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:55 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1653 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:55.526381 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e33ac2bc-632e-4c5b-8e34-09acccc114ae tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.227887 Jul 07 07:23:55.527081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 232/469] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:55 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:55.543535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-36009241-10b4-4106-8ac6-feb06488b78d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:55.550903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36009241-10b4-4106-8ac6-feb06488b78d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.551354 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36009241-10b4-4106-8ac6-feb06488b78d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.552410 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-96c586d2-1d44-42a3-807c-e8bb7f5c8856 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:55.553190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-96c586d2-1d44-42a3-807c-e8bb7f5c8856 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:55.560824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96c586d2-1d44-42a3-807c-e8bb7f5c8856 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.561324 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96c586d2-1d44-42a3-807c-e8bb7f5c8856 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.562165 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96c586d2-1d44-42a3-807c-e8bb7f5c8856 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.562597 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-96c586d2-1d44-42a3-807c-e8bb7f5c8856 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.579964 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-36009241-10b4-4106-8ac6-feb06488b78d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Going to try to start instance {{(pid=117787) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 07 07:23:55.630591 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-36009241-10b4-4106-8ac6-feb06488b78d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/action" status: 202 len: 0 microversion: 2.1 time: 0.090953 Jul 07 07:23:55.631226 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 238/470] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:23:55 2022] POST /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 07:23:55.640506 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cd0c22cf-a665-457d-a468-64a63be726c2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:55.641240 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cd0c22cf-a665-457d-a468-64a63be726c2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:55.649906 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd0c22cf-a665-457d-a468-64a63be726c2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.650365 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd0c22cf-a665-457d-a468-64a63be726c2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.651364 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd0c22cf-a665-457d-a468-64a63be726c2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:55.651788 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cd0c22cf-a665-457d-a468-64a63be726c2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:55.738120 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-96c586d2-1d44-42a3-807c-e8bb7f5c8856 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:55.745861 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-96c586d2-1d44-42a3-807c-e8bb7f5c8856 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1682 microversion: 2.1 time: 0.197490 Jul 07 07:23:55.746447 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 233/471] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:55 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:56.131726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cd0c22cf-a665-457d-a468-64a63be726c2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:56.149361 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cd0c22cf-a665-457d-a468-64a63be726c2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1662 microversion: 2.1 time: 0.512717 Jul 07 07:23:56.150916 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 239/472] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:55 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1662 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:56.272421 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6c8ae508-ee59-40ff-bf52-fba8ba57c913 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:56.273148 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6c8ae508-ee59-40ff-bf52-fba8ba57c913 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:56.278437 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fb7a0b77-74fa-4de8-8fe8-f2d28ee069f7 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:56.279608 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fb7a0b77-74fa-4de8-8fe8-f2d28ee069f7 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:56.280922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c8ae508-ee59-40ff-bf52-fba8ba57c913 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:56.281910 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c8ae508-ee59-40ff-bf52-fba8ba57c913 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:56.282885 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c8ae508-ee59-40ff-bf52-fba8ba57c913 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:56.283557 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6c8ae508-ee59-40ff-bf52-fba8ba57c913 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:56.288525 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb7a0b77-74fa-4de8-8fe8-f2d28ee069f7 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:56.289157 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb7a0b77-74fa-4de8-8fe8-f2d28ee069f7 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:56.290864 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb7a0b77-74fa-4de8-8fe8-f2d28ee069f7 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:56.291522 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb7a0b77-74fa-4de8-8fe8-f2d28ee069f7 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:56.504406 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6c8ae508-ee59-40ff-bf52-fba8ba57c913 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:56.508502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fb7a0b77-74fa-4de8-8fe8-f2d28ee069f7 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:56.513255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6c8ae508-ee59-40ff-bf52-fba8ba57c913 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.245390 Jul 07 07:23:56.513824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 234/473] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:56 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:56.517549 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fb7a0b77-74fa-4de8-8fe8-f2d28ee069f7 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.243511 Jul 07 07:23:56.518840 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 240/474] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:56 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:56.544186 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a97b0586-2004-4022-8bad-c0aa49166e18 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:56.544791 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a97b0586-2004-4022-8bad-c0aa49166e18 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:56.551956 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a97b0586-2004-4022-8bad-c0aa49166e18 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:56.552412 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a97b0586-2004-4022-8bad-c0aa49166e18 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:56.553200 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a97b0586-2004-4022-8bad-c0aa49166e18 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:56.553740 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a97b0586-2004-4022-8bad-c0aa49166e18 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:56.700284 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a97b0586-2004-4022-8bad-c0aa49166e18 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:56.709931 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a97b0586-2004-4022-8bad-c0aa49166e18 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:56.711465 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a97b0586-2004-4022-8bad-c0aa49166e18 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:56.712680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a97b0586-2004-4022-8bad-c0aa49166e18 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.172518 Jul 07 07:23:56.713331 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 235/475] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:56 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:56.763438 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-360bbf02-9b4c-4b17-9241-0e3f9fff000c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:56.764049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-360bbf02-9b4c-4b17-9241-0e3f9fff000c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:56.771511 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-360bbf02-9b4c-4b17-9241-0e3f9fff000c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:56.771957 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-360bbf02-9b4c-4b17-9241-0e3f9fff000c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:56.772758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-360bbf02-9b4c-4b17-9241-0e3f9fff000c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:56.773182 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-360bbf02-9b4c-4b17-9241-0e3f9fff000c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:56.925466 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-360bbf02-9b4c-4b17-9241-0e3f9fff000c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:56.934052 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-360bbf02-9b4c-4b17-9241-0e3f9fff000c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1682 microversion: 2.1 time: 0.174371 Jul 07 07:23:56.934654 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 241/476] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:56 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:57.168336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f310c55-daa6-4ec8-9250-95dd3ba6ae0c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:57.168979 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3f310c55-daa6-4ec8-9250-95dd3ba6ae0c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:57.171270 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:57.176991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f310c55-daa6-4ec8-9250-95dd3ba6ae0c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.177459 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f310c55-daa6-4ec8-9250-95dd3ba6ae0c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:57.178243 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f310c55-daa6-4ec8-9250-95dd3ba6ae0c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.178672 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f310c55-daa6-4ec8-9250-95dd3ba6ae0c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:57.331425 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3f310c55-daa6-4ec8-9250-95dd3ba6ae0c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:57.341286 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3f310c55-daa6-4ec8-9250-95dd3ba6ae0c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1662 microversion: 2.1 time: 0.176818 Jul 07 07:23:57.342091 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 236/477] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:57 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1662 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:57.537110 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8e433254-e05b-41fc-b764-4e557b6e712b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:57.537760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8e433254-e05b-41fc-b764-4e557b6e712b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:57.541640 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cd7f4cff-c05a-4299-a0e6-5884c0c8dc9f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:57.542322 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cd7f4cff-c05a-4299-a0e6-5884c0c8dc9f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:57.545274 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e433254-e05b-41fc-b764-4e557b6e712b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.545724 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e433254-e05b-41fc-b764-4e557b6e712b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:57.546538 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e433254-e05b-41fc-b764-4e557b6e712b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.547183 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e433254-e05b-41fc-b764-4e557b6e712b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:57.550287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd7f4cff-c05a-4299-a0e6-5884c0c8dc9f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.551047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd7f4cff-c05a-4299-a0e6-5884c0c8dc9f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:57.551963 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd7f4cff-c05a-4299-a0e6-5884c0c8dc9f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.552811 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd7f4cff-c05a-4299-a0e6-5884c0c8dc9f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:57.784186 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cd7f4cff-c05a-4299-a0e6-5884c0c8dc9f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:57.786298 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8e433254-e05b-41fc-b764-4e557b6e712b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:57.795307 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8e433254-e05b-41fc-b764-4e557b6e712b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.268091 Jul 07 07:23:57.796614 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 242/478] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:57 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:57.804126 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-b101182d-b97e-4bdb-affc-e48756b21ef8 req-fe643f65-97b9-459b-8cce-07d23c42b150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8e7489d-0481-4cfe-8e7d-4d9bd447f492", "name": "network-vif-deleted", "tag": "2adf9380-5032-4847-a6c2-7a57d1b430dd"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:23:57.811760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cd7f4cff-c05a-4299-a0e6-5884c0c8dc9f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1258 microversion: 2.1 time: 0.280608 Jul 07 07:23:57.812678 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 237/479] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:57 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1258 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:57.826651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6277b93c-9c6e-470e-89db-788dc9cc05b4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:57.827387 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b101182d-b97e-4bdb-affc-e48756b21ef8 req-fe643f65-97b9-459b-8cce-07d23c42b150 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.828035 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b101182d-b97e-4bdb-affc-e48756b21ef8 req-fe643f65-97b9-459b-8cce-07d23c42b150 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:57.828548 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6277b93c-9c6e-470e-89db-788dc9cc05b4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:57.835639 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6277b93c-9c6e-470e-89db-788dc9cc05b4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.836348 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6277b93c-9c6e-470e-89db-788dc9cc05b4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:57.837402 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6277b93c-9c6e-470e-89db-788dc9cc05b4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.838030 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6277b93c-9c6e-470e-89db-788dc9cc05b4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:57.864238 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-b101182d-b97e-4bdb-affc-e48756b21ef8 req-fe643f65-97b9-459b-8cce-07d23c42b150 service nova] Creating event network-vif-deleted:2adf9380-5032-4847-a6c2-7a57d1b430dd for instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 on hv-cinder-82660 Jul 07 07:23:57.873295 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-b101182d-b97e-4bdb-affc-e48756b21ef8 req-fe643f65-97b9-459b-8cce-07d23c42b150 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073117 Jul 07 07:23:57.874757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 243/480] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:23:57.954638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7d202163-76a0-4149-a41d-b03d8a117489 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:57.955367 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7d202163-76a0-4149-a41d-b03d8a117489 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:57.963356 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d202163-76a0-4149-a41d-b03d8a117489 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.963813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d202163-76a0-4149-a41d-b03d8a117489 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:57.964880 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d202163-76a0-4149-a41d-b03d8a117489 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:57.965514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d202163-76a0-4149-a41d-b03d8a117489 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:58.052562 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7d202163-76a0-4149-a41d-b03d8a117489 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:58.054821 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6277b93c-9c6e-470e-89db-788dc9cc05b4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:58.066572 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6277b93c-9c6e-470e-89db-788dc9cc05b4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:58.068919 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6277b93c-9c6e-470e-89db-788dc9cc05b4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:58.069730 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7d202163-76a0-4149-a41d-b03d8a117489 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1327 microversion: 2.1 time: 0.120620 Jul 07 07:23:58.070280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6277b93c-9c6e-470e-89db-788dc9cc05b4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.247531 Jul 07 07:23:58.079823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 244/481] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:57 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:23:58.081737 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 238/482] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:57 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:58.359858 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5a6d6526-73fc-4c20-b282-802cd5ac8a5d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:58.360492 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5a6d6526-73fc-4c20-b282-802cd5ac8a5d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:58.362728 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:58.368412 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a6d6526-73fc-4c20-b282-802cd5ac8a5d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:58.368865 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a6d6526-73fc-4c20-b282-802cd5ac8a5d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:58.369703 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a6d6526-73fc-4c20-b282-802cd5ac8a5d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:58.370232 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5a6d6526-73fc-4c20-b282-802cd5ac8a5d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:58.593906 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5a6d6526-73fc-4c20-b282-802cd5ac8a5d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:58.608766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5a6d6526-73fc-4c20-b282-802cd5ac8a5d tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1662 microversion: 2.1 time: 0.252715 Jul 07 07:23:58.610788 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 245/483] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:58 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1662 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:58.815064 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-81a7a60a-700c-44c9-b589-e9cd36be819b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:58.815705 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-81a7a60a-700c-44c9-b589-e9cd36be819b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:58.832249 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-28a2a618-d6c2-4057-8fcd-d7a75f1ff155 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:58.833380 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-28a2a618-d6c2-4057-8fcd-d7a75f1ff155 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:58.838193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-81a7a60a-700c-44c9-b589-e9cd36be819b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:58.838193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-81a7a60a-700c-44c9-b589-e9cd36be819b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:58.838893 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-81a7a60a-700c-44c9-b589-e9cd36be819b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:58.843521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-81a7a60a-700c-44c9-b589-e9cd36be819b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:58.844584 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-28a2a618-d6c2-4057-8fcd-d7a75f1ff155 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:58.845041 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-28a2a618-d6c2-4057-8fcd-d7a75f1ff155 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:58.845859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-28a2a618-d6c2-4057-8fcd-d7a75f1ff155 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:58.846295 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-28a2a618-d6c2-4057-8fcd-d7a75f1ff155 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:59.103062 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-28a2a618-d6c2-4057-8fcd-d7a75f1ff155 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:59.115855 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-28a2a618-d6c2-4057-8fcd-d7a75f1ff155 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1441 microversion: 2.1 time: 0.287852 Jul 07 07:23:59.123138 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-81a7a60a-700c-44c9-b589-e9cd36be819b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:59.127721 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 246/484] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:58 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1441 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:59.134167 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:59.134993 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:59.143248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-81a7a60a-700c-44c9-b589-e9cd36be819b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.331674 Jul 07 07:23:59.150193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 239/485] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:58 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:59.158276 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:59.158728 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9873b173-6500-48fb-923a-487d96feaba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:59.158846 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:59.159604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9873b173-6500-48fb-923a-487d96feaba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:59.160052 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:59.160052 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:59.167263 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9873b173-6500-48fb-923a-487d96feaba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:59.168003 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9873b173-6500-48fb-923a-487d96feaba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:59.169180 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9873b173-6500-48fb-923a-487d96feaba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:59.169837 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9873b173-6500-48fb-923a-487d96feaba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:59.221071 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:59.225971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:59.226741 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lazy-loading 'fault' on Instance uuid f8e7489d-0481-4cfe-8e7d-4d9bd447f492 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:23:59.407307 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:59.418643 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b3f2e167-2f72-453d-a636-f13d0053c940 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 200 len: 1332 microversion: 2.1 time: 0.289369 Jul 07 07:23:59.422030 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 247/486] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:59 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 1332 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:59.428199 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c260146a-4769-4bb7-adfb-29344ef79266 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:59.429135 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c260146a-4769-4bb7-adfb-29344ef79266 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:59.442978 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c260146a-4769-4bb7-adfb-29344ef79266 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:59.443431 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c260146a-4769-4bb7-adfb-29344ef79266 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:59.444224 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c260146a-4769-4bb7-adfb-29344ef79266 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:59.444658 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c260146a-4769-4bb7-adfb-29344ef79266 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:59.467658 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9873b173-6500-48fb-923a-487d96feaba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:59.481265 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9873b173-6500-48fb-923a-487d96feaba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:59.486830 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9873b173-6500-48fb-923a-487d96feaba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:59.491199 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9873b173-6500-48fb-923a-487d96feaba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1806 microversion: 2.20 time: 0.337014 Jul 07 07:23:59.494268 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 240/487] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:23:59 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1806 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:23:59.623243 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c260146a-4769-4bb7-adfb-29344ef79266 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:59.631977 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-704f8aeb-56be-4588-8598-464e9f72615a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:23:59.633024 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-704f8aeb-56be-4588-8598-464e9f72615a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:23:59.633272 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c260146a-4769-4bb7-adfb-29344ef79266 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1441 microversion: 2.1 time: 0.209753 Jul 07 07:23:59.633934 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 248/488] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:59 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1441 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:23:59.650161 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-704f8aeb-56be-4588-8598-464e9f72615a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:59.651100 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-704f8aeb-56be-4588-8598-464e9f72615a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:59.659059 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-704f8aeb-56be-4588-8598-464e9f72615a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:23:59.659687 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-704f8aeb-56be-4588-8598-464e9f72615a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:23:59.672251 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:23:59.852361 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-704f8aeb-56be-4588-8598-464e9f72615a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:23:59.862616 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-704f8aeb-56be-4588-8598-464e9f72615a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1662 microversion: 2.1 time: 0.237017 Jul 07 07:23:59.864833 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 241/489] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:23:59 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1662 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:00.162272 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aabd5d5f-4fd6-41ab-a8e9-917b749a6add tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:00.162917 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aabd5d5f-4fd6-41ab-a8e9-917b749a6add tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:00.171505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aabd5d5f-4fd6-41ab-a8e9-917b749a6add tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:00.171956 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aabd5d5f-4fd6-41ab-a8e9-917b749a6add tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:00.172982 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aabd5d5f-4fd6-41ab-a8e9-917b749a6add tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:00.173780 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aabd5d5f-4fd6-41ab-a8e9-917b749a6add tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:00.333409 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aabd5d5f-4fd6-41ab-a8e9-917b749a6add tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:00.349707 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aabd5d5f-4fd6-41ab-a8e9-917b749a6add tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.191062 Jul 07 07:24:00.350391 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 249/490] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:00 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:00.439419 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f9f16832-f4e3-45ce-a418-432b2d54dcb9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:00.440163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f9f16832-f4e3-45ce-a418-432b2d54dcb9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:00.446562 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f9f16832-f4e3-45ce-a418-432b2d54dcb9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:00.446979 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f9f16832-f4e3-45ce-a418-432b2d54dcb9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:00.447755 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f9f16832-f4e3-45ce-a418-432b2d54dcb9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:00.448253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f9f16832-f4e3-45ce-a418-432b2d54dcb9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:00.462966 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-f9f16832-f4e3-45ce-a418-432b2d54dcb9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f9f16832-f4e3-45ce-a418-432b2d54dcb9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 HTTP/1.1 Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:24:00.464651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:24:00.466229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'f8e7489d-0481-4cfe-8e7d-4d9bd447f492'} Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:24:00.467207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:24:00.468929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:00.471401 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f9f16832-f4e3-45ce-a418-432b2d54dcb9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:24:00.471401 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f9f16832-f4e3-45ce-a418-432b2d54dcb9 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 404 len: 111 microversion: 2.1 time: 0.031112 Jul 07 07:24:00.471401 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 242/491] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:00 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:24:00.481258 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-38e89db5-1ae9-49f1-b6ad-1d3985fdb531 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '.version_select at 0x7fccfa1f3430>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:00.514513 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c7fc956a-a778-4084-b626-32ebaef61923 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:00.515070 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-38e89db5-1ae9-49f1-b6ad-1d3985fdb531 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553152927" status: 202 len: 0 microversion: 2.1 time: 0.040300 Jul 07 07:24:00.515196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c7fc956a-a778-4084-b626-32ebaef61923 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:00.516647 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 250/492] 10.222.0.62 () {58 vars in 1220 bytes} [Thu Jul 7 07:24:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1553152927 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:24:00.522566 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7fc956a-a778-4084-b626-32ebaef61923 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:00.523133 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7fc956a-a778-4084-b626-32ebaef61923 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:00.524111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7fc956a-a778-4084-b626-32ebaef61923 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:00.524603 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7fc956a-a778-4084-b626-32ebaef61923 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:00.684597 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c7fc956a-a778-4084-b626-32ebaef61923 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:00.695248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c7fc956a-a778-4084-b626-32ebaef61923 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:00.697442 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c7fc956a-a778-4084-b626-32ebaef61923 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:00.699556 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c7fc956a-a778-4084-b626-32ebaef61923 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1793 microversion: 2.20 time: 0.189113 Jul 07 07:24:00.700228 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 243/493] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:24:00 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1793 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:24:00.884122 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-093237a3-2e87-4390-be1b-b111704685e1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:00.884745 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-093237a3-2e87-4390-be1b-b111704685e1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:00.893066 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-093237a3-2e87-4390-be1b-b111704685e1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:00.893554 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-093237a3-2e87-4390-be1b-b111704685e1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:00.894776 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-093237a3-2e87-4390-be1b-b111704685e1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:00.895406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-093237a3-2e87-4390-be1b-b111704685e1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:01.236120 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-093237a3-2e87-4390-be1b-b111704685e1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:01.279149 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-093237a3-2e87-4390-be1b-b111704685e1 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1662 microversion: 2.1 time: 0.399863 Jul 07 07:24:01.280911 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 251/494] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:00 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1662 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:01.370103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2f45a992-ecea-429f-b936-c3f3170c236a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:01.370714 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2f45a992-ecea-429f-b936-c3f3170c236a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:01.378278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f45a992-ecea-429f-b936-c3f3170c236a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:01.378757 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f45a992-ecea-429f-b936-c3f3170c236a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:01.379923 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f45a992-ecea-429f-b936-c3f3170c236a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:01.380361 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2f45a992-ecea-429f-b936-c3f3170c236a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:01.600008 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2f45a992-ecea-429f-b936-c3f3170c236a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:01.617962 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2f45a992-ecea-429f-b936-c3f3170c236a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.251689 Jul 07 07:24:01.620592 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 244/495] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:01 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:01.831946 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-613c5deb-55d0-4780-9c5f-1853e008c5fe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:01.832553 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-613c5deb-55d0-4780-9c5f-1853e008c5fe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:01.839110 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-613c5deb-55d0-4780-9c5f-1853e008c5fe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:01.839671 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-613c5deb-55d0-4780-9c5f-1853e008c5fe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:01.840533 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-613c5deb-55d0-4780-9c5f-1853e008c5fe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:01.841205 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-613c5deb-55d0-4780-9c5f-1853e008c5fe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:01.988516 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:01.992803 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-613c5deb-55d0-4780-9c5f-1853e008c5fe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lazy-loading 'services' on Instance uuid 9f327dd6-9e19-4aa6-bdb1-7706c651c08c {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:24:02.054495 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-165f23a7-2ae6-4ce7-bbb2-cca15a5d4bd6 req-3486e52e-2d7d-44e0-8a63-918f39efc28f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83944e7d-3750-4747-92ae-6a1f735c79fc", "tag": "19dfde08-41d9-41e9-b31b-405a6dc8008a"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:02.065250 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-165f23a7-2ae6-4ce7-bbb2-cca15a5d4bd6 req-3486e52e-2d7d-44e0-8a63-918f39efc28f service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:02.066232 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-165f23a7-2ae6-4ce7-bbb2-cca15a5d4bd6 req-3486e52e-2d7d-44e0-8a63-918f39efc28f service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:02.081501 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-165f23a7-2ae6-4ce7-bbb2-cca15a5d4bd6 req-3486e52e-2d7d-44e0-8a63-918f39efc28f service nova] Creating event network-changed:19dfde08-41d9-41e9-b31b-405a6dc8008a for instance 83944e7d-3750-4747-92ae-6a1f735c79fc on hv-cinder-82660 Jul 07 07:24:02.088721 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-165f23a7-2ae6-4ce7-bbb2-cca15a5d4bd6 req-3486e52e-2d7d-44e0-8a63-918f39efc28f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038505 Jul 07 07:24:02.089891 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 245/496] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:02.155233 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-613c5deb-55d0-4780-9c5f-1853e008c5fe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-volume_attachments/2cc8958a-8bf9-4d14-880f-bb692be31594" status: 202 len: 0 microversion: 2.1 time: 0.327245 Jul 07 07:24:02.156682 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 252/497] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:24:01 2022] DELETE /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-volume_attachments/2cc8958a-8bf9-4d14-880f-bb692be31594 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:24:02.166126 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6490e524-3f0f-452a-8a4b-41e6100f5b82 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:02.167193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6490e524-3f0f-452a-8a4b-41e6100f5b82 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:02.176700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6490e524-3f0f-452a-8a4b-41e6100f5b82 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:02.177492 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6490e524-3f0f-452a-8a4b-41e6100f5b82 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:02.178314 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6490e524-3f0f-452a-8a4b-41e6100f5b82 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:02.178768 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6490e524-3f0f-452a-8a4b-41e6100f5b82 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:02.211847 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6490e524-3f0f-452a-8a4b-41e6100f5b82 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050430 Jul 07 07:24:02.212925 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 246/498] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:24:02 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:02.302049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1f93bebd-45e2-4ba7-8f07-896ca85b3ab6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:02.302773 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1f93bebd-45e2-4ba7-8f07-896ca85b3ab6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:02.311469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f93bebd-45e2-4ba7-8f07-896ca85b3ab6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:02.311757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f93bebd-45e2-4ba7-8f07-896ca85b3ab6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:02.312639 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f93bebd-45e2-4ba7-8f07-896ca85b3ab6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:02.313100 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f93bebd-45e2-4ba7-8f07-896ca85b3ab6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:02.456108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1f93bebd-45e2-4ba7-8f07-896ca85b3ab6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:02.465004 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1f93bebd-45e2-4ba7-8f07-896ca85b3ab6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1666 microversion: 2.1 time: 0.167447 Jul 07 07:24:02.465548 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 253/499] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:02 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1666 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:02.636443 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ef3d1431-97ff-45a1-8242-703e79b48378 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:02.637067 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ef3d1431-97ff-45a1-8242-703e79b48378 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:02.644430 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef3d1431-97ff-45a1-8242-703e79b48378 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:02.644925 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef3d1431-97ff-45a1-8242-703e79b48378 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:02.646180 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef3d1431-97ff-45a1-8242-703e79b48378 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:02.646454 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ef3d1431-97ff-45a1-8242-703e79b48378 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:02.838880 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ef3d1431-97ff-45a1-8242-703e79b48378 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:02.847497 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ef3d1431-97ff-45a1-8242-703e79b48378 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.214942 Jul 07 07:24:02.848356 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 247/500] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:02 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:03.225879 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-da3e4b81-c7e6-4bd3-a6d8-84237ab3ce15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:03.226863 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-da3e4b81-c7e6-4bd3-a6d8-84237ab3ce15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:03.234363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da3e4b81-c7e6-4bd3-a6d8-84237ab3ce15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:03.234814 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da3e4b81-c7e6-4bd3-a6d8-84237ab3ce15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:03.243961 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da3e4b81-c7e6-4bd3-a6d8-84237ab3ce15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:03.248333 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da3e4b81-c7e6-4bd3-a6d8-84237ab3ce15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:03.289408 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-da3e4b81-c7e6-4bd3-a6d8-84237ab3ce15 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067862 Jul 07 07:24:03.289999 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 254/501] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:24:03 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:03.723736 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-2f748ba2-d5dc-41aa-90b9-10123689e739 req-5fa23102-043e-490b-8bbd-ddbef5ade666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e219f102-9056-42d4-86fd-4a0f8348d041", "name": "network-vif-plugged", "status": "completed", "tag": "93dad3d5-bbb3-4950-91cc-7f4d0c71fe54"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:03.733145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2f748ba2-d5dc-41aa-90b9-10123689e739 req-5fa23102-043e-490b-8bbd-ddbef5ade666 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:03.733683 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2f748ba2-d5dc-41aa-90b9-10123689e739 req-5fa23102-043e-490b-8bbd-ddbef5ade666 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:03.747034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-2f748ba2-d5dc-41aa-90b9-10123689e739 req-5fa23102-043e-490b-8bbd-ddbef5ade666 service nova] Creating event network-vif-plugged:93dad3d5-bbb3-4950-91cc-7f4d0c71fe54 for instance e219f102-9056-42d4-86fd-4a0f8348d041 on hv-cinder-82660 Jul 07 07:24:03.753071 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-2f748ba2-d5dc-41aa-90b9-10123689e739 req-5fa23102-043e-490b-8bbd-ddbef5ade666 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Jul 07 07:24:03.754142 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 248/502] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:24:03.864499 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-25b0984c-4c48-4a17-9d2e-e5cfea886b56 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:03.865303 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-25b0984c-4c48-4a17-9d2e-e5cfea886b56 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:03.872507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25b0984c-4c48-4a17-9d2e-e5cfea886b56 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:03.872926 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25b0984c-4c48-4a17-9d2e-e5cfea886b56 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:03.873789 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25b0984c-4c48-4a17-9d2e-e5cfea886b56 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:03.874218 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-25b0984c-4c48-4a17-9d2e-e5cfea886b56 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:04.048497 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-25b0984c-4c48-4a17-9d2e-e5cfea886b56 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:04.056322 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-25b0984c-4c48-4a17-9d2e-e5cfea886b56 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.195813 Jul 07 07:24:04.056943 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 255/503] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:03 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:24:04.303774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1097d72c-cd28-4465-8c45-0d65b8762aed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:04.304781 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1097d72c-cd28-4465-8c45-0d65b8762aed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:04.311969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1097d72c-cd28-4465-8c45-0d65b8762aed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:04.312515 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1097d72c-cd28-4465-8c45-0d65b8762aed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:04.313497 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1097d72c-cd28-4465-8c45-0d65b8762aed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:04.313941 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1097d72c-cd28-4465-8c45-0d65b8762aed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:04.348694 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1097d72c-cd28-4465-8c45-0d65b8762aed tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048539 Jul 07 07:24:04.353289 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 249/504] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:24:04 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 07:24:04.420049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-df736268-f1fc-4c3e-af3a-35247e973302 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:04.420710 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-df736268-f1fc-4c3e-af3a-35247e973302 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:04.431171 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df736268-f1fc-4c3e-af3a-35247e973302 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:04.431779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df736268-f1fc-4c3e-af3a-35247e973302 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:04.433073 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df736268-f1fc-4c3e-af3a-35247e973302 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:04.433859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-df736268-f1fc-4c3e-af3a-35247e973302 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:04.470697 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-df736268-f1fc-4c3e-af3a-35247e973302 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:24:04.556509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-df736268-f1fc-4c3e-af3a-35247e973302 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 204 len: 0 microversion: 2.1 time: 0.142691 Jul 07 07:24:04.557013 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 256/505] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:24:04 2022] DELETE /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:24:04.566169 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-209c0baf-7fe9-4e06-b4fe-ad79fcac4c50 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:04.566810 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-209c0baf-7fe9-4e06-b4fe-ad79fcac4c50 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:04.573330 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-209c0baf-7fe9-4e06-b4fe-ad79fcac4c50 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:04.573782 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-209c0baf-7fe9-4e06-b4fe-ad79fcac4c50 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:04.574557 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-209c0baf-7fe9-4e06-b4fe-ad79fcac4c50 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:04.574994 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-209c0baf-7fe9-4e06-b4fe-ad79fcac4c50 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:04.723877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-209c0baf-7fe9-4e06-b4fe-ad79fcac4c50 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:04.732042 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-209c0baf-7fe9-4e06-b4fe-ad79fcac4c50 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1681 microversion: 2.1 time: 0.169757 Jul 07 07:24:04.732830 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 250/506] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:04 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:05.074921 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-23768b1c-1f17-4c8d-b4fb-757a658fa9e2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:05.075628 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-23768b1c-1f17-4c8d-b4fb-757a658fa9e2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:05.083720 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23768b1c-1f17-4c8d-b4fb-757a658fa9e2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:05.083720 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23768b1c-1f17-4c8d-b4fb-757a658fa9e2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:05.085132 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23768b1c-1f17-4c8d-b4fb-757a658fa9e2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:05.085605 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-23768b1c-1f17-4c8d-b4fb-757a658fa9e2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:05.242235 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-23768b1c-1f17-4c8d-b4fb-757a658fa9e2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:05.251254 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-23768b1c-1f17-4c8d-b4fb-757a658fa9e2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.180529 Jul 07 07:24:05.251856 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 257/507] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:05 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:05.750457 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-92ea709b-88a0-42b3-acd8-1e9cd2d7690f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:05.751016 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-92ea709b-88a0-42b3-acd8-1e9cd2d7690f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:05.758296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92ea709b-88a0-42b3-acd8-1e9cd2d7690f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:05.758747 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92ea709b-88a0-42b3-acd8-1e9cd2d7690f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:05.759858 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92ea709b-88a0-42b3-acd8-1e9cd2d7690f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:05.760589 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-92ea709b-88a0-42b3-acd8-1e9cd2d7690f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:05.912171 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-92ea709b-88a0-42b3-acd8-1e9cd2d7690f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:05.921450 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-92ea709b-88a0-42b3-acd8-1e9cd2d7690f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1681 microversion: 2.1 time: 0.175077 Jul 07 07:24:05.922053 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 251/508] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:05 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:06.270386 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7aa5f46a-9843-4b0e-ae28-951d2a469ba9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:06.270962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7aa5f46a-9843-4b0e-ae28-951d2a469ba9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:06.278470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7aa5f46a-9843-4b0e-ae28-951d2a469ba9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:06.278924 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7aa5f46a-9843-4b0e-ae28-951d2a469ba9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:06.279722 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7aa5f46a-9843-4b0e-ae28-951d2a469ba9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:06.280157 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7aa5f46a-9843-4b0e-ae28-951d2a469ba9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:06.428270 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7aa5f46a-9843-4b0e-ae28-951d2a469ba9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:06.437009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7aa5f46a-9843-4b0e-ae28-951d2a469ba9 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1358 microversion: 2.1 time: 0.170421 Jul 07 07:24:06.437857 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 258/509] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:06 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:06.944280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d9a1f467-81b0-4b05-9451-1e6628276fb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:06.944911 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d9a1f467-81b0-4b05-9451-1e6628276fb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:06.951609 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9a1f467-81b0-4b05-9451-1e6628276fb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:06.952059 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9a1f467-81b0-4b05-9451-1e6628276fb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:06.952938 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9a1f467-81b0-4b05-9451-1e6628276fb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:06.953426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9a1f467-81b0-4b05-9451-1e6628276fb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:07.095652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d9a1f467-81b0-4b05-9451-1e6628276fb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:07.104029 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d9a1f467-81b0-4b05-9451-1e6628276fb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1681 microversion: 2.1 time: 0.163474 Jul 07 07:24:07.104642 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 252/510] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:06 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:07.454727 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b2eb346d-8e7f-4809-b446-efb9e5376ac7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:07.455329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b2eb346d-8e7f-4809-b446-efb9e5376ac7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:07.462677 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2eb346d-8e7f-4809-b446-efb9e5376ac7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:07.463123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2eb346d-8e7f-4809-b446-efb9e5376ac7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:07.463937 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2eb346d-8e7f-4809-b446-efb9e5376ac7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:07.464725 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b2eb346d-8e7f-4809-b446-efb9e5376ac7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:07.630295 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b2eb346d-8e7f-4809-b446-efb9e5376ac7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:07.638775 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b2eb346d-8e7f-4809-b446-efb9e5376ac7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1547 microversion: 2.1 time: 0.188072 Jul 07 07:24:07.639376 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 259/511] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:07 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1547 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:07.659262 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-537cbfc3-85d7-4ac9-be03-b0d4a85e6e87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:07.660074 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-537cbfc3-85d7-4ac9-be03-b0d4a85e6e87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:07.667192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-537cbfc3-85d7-4ac9-be03-b0d4a85e6e87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:07.667540 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-537cbfc3-85d7-4ac9-be03-b0d4a85e6e87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:07.668358 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-537cbfc3-85d7-4ac9-be03-b0d4a85e6e87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:07.668818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-537cbfc3-85d7-4ac9-be03-b0d4a85e6e87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:07.833436 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-537cbfc3-85d7-4ac9-be03-b0d4a85e6e87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:07.845436 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-537cbfc3-85d7-4ac9-be03-b0d4a85e6e87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1547 microversion: 2.1 time: 0.191587 Jul 07 07:24:07.846401 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 253/512] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:07 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1547 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:07.864449 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d3c70cd8-98ac-4279-b205-497528e76892 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:07.868326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d3c70cd8-98ac-4279-b205-497528e76892 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:07.869110 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d3c70cd8-98ac-4279-b205-497528e76892 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Searching by: {'deleted': False, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3'} {{(pid=117787) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 07 07:24:07.877011 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d3c70cd8-98ac-4279-b205-497528e76892 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:07.877506 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d3c70cd8-98ac-4279-b205-497528e76892 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:07.878319 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d3c70cd8-98ac-4279-b205-497528e76892 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:07.878748 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d3c70cd8-98ac-4279-b205-497528e76892 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:07.978656 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.multi_cell_list [None req-d3c70cd8-98ac-4279-b205-497528e76892 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117787) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 07 07:24:08.080421 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d3c70cd8-98ac-4279-b205-497528e76892 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.220041 Jul 07 07:24:08.081058 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 260/513] 10.222.0.62 () {58 vars in 1124 bytes} [Thu Jul 7 07:24:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:08.096349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dfeea766-3763-4cc7-82c7-4e62d3ef5ea3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:08.097616 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dfeea766-3763-4cc7-82c7-4e62d3ef5ea3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:08.107077 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dfeea766-3763-4cc7-82c7-4e62d3ef5ea3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:08.107828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dfeea766-3763-4cc7-82c7-4e62d3ef5ea3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:08.108707 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dfeea766-3763-4cc7-82c7-4e62d3ef5ea3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:08.109236 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dfeea766-3763-4cc7-82c7-4e62d3ef5ea3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:08.128502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-803f8e48-1949-419a-ba5d-7940cb288a4a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:08.129628 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-803f8e48-1949-419a-ba5d-7940cb288a4a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:08.141054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-803f8e48-1949-419a-ba5d-7940cb288a4a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:08.141873 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-803f8e48-1949-419a-ba5d-7940cb288a4a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:08.143295 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-803f8e48-1949-419a-ba5d-7940cb288a4a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:08.144082 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-803f8e48-1949-419a-ba5d-7940cb288a4a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:08.264323 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-803f8e48-1949-419a-ba5d-7940cb288a4a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:08.286981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-803f8e48-1949-419a-ba5d-7940cb288a4a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1613 microversion: 2.1 time: 0.167525 Jul 07 07:24:08.287777 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 261/514] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:08 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1613 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:24:08.300813 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dfeea766-3763-4cc7-82c7-4e62d3ef5ea3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:08.313561 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dfeea766-3763-4cc7-82c7-4e62d3ef5ea3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1547 microversion: 2.1 time: 0.224344 Jul 07 07:24:08.313993 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 254/515] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:08 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1547 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:08.902524 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-a4680429-ea69-41c1-97a8-c9d891912885 req-334b11d0-f8bc-4d85-85ec-572cc03e3edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f327dd6-9e19-4aa6-bdb1-7706c651c08c", "name": "network-vif-deleted", "tag": "a0f4f29b-0ccc-4bff-bdf2-1469d945011f"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:08.919849 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a4680429-ea69-41c1-97a8-c9d891912885 req-334b11d0-f8bc-4d85-85ec-572cc03e3edf service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:08.920681 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a4680429-ea69-41c1-97a8-c9d891912885 req-334b11d0-f8bc-4d85-85ec-572cc03e3edf service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:08.943027 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-a4680429-ea69-41c1-97a8-c9d891912885 req-334b11d0-f8bc-4d85-85ec-572cc03e3edf service nova] Creating event network-vif-deleted:a0f4f29b-0ccc-4bff-bdf2-1469d945011f for instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c on hv-cinder-82660 Jul 07 07:24:08.952554 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-a4680429-ea69-41c1-97a8-c9d891912885 req-334b11d0-f8bc-4d85-85ec-572cc03e3edf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054369 Jul 07 07:24:08.954223 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 262/516] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:24:09.304545 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:09.305161 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:09.314247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:09.315164 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:09.316564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:09.317658 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:09.357370 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:09.357881 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:09.358340 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lazy-loading 'fault' on Instance uuid 9f327dd6-9e19-4aa6-bdb1-7706c651c08c {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:24:09.402673 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:09.411158 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3e7177ea-8e4e-4732-acfb-4aa3dc5693f5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 200 len: 1331 microversion: 2.1 time: 0.110604 Jul 07 07:24:09.411808 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 255/517] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:09 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:10.066596 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-176e968a-5a7a-46b5-9b5c-619c4e2924f5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:10.067575 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-176e968a-5a7a-46b5-9b5c-619c4e2924f5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:10.075859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-176e968a-5a7a-46b5-9b5c-619c4e2924f5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:10.076307 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-176e968a-5a7a-46b5-9b5c-619c4e2924f5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:10.077139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-176e968a-5a7a-46b5-9b5c-619c4e2924f5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:10.077905 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-176e968a-5a7a-46b5-9b5c-619c4e2924f5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:10.415000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-176e968a-5a7a-46b5-9b5c-619c4e2924f5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "POST /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.353076 Jul 07 07:24:10.415690 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 263/518] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:24:10 2022] POST /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:10.429169 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e448ef47-0d4f-489b-98fd-292b9bce1576 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:10.429963 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e448ef47-0d4f-489b-98fd-292b9bce1576 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:10.438317 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e448ef47-0d4f-489b-98fd-292b9bce1576 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:10.438940 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e448ef47-0d4f-489b-98fd-292b9bce1576 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:10.439813 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e448ef47-0d4f-489b-98fd-292b9bce1576 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:10.440966 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e448ef47-0d4f-489b-98fd-292b9bce1576 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:10.458410 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-e448ef47-0d4f-489b-98fd-292b9bce1576 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e448ef47-0d4f-489b-98fd-292b9bce1576 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c HTTP/1.1 Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:24:10.460131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:24:10.461535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '9f327dd6-9e19-4aa6-bdb1-7706c651c08c'} Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:24:10.462280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:24:10.463608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:10.464631 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e448ef47-0d4f-489b-98fd-292b9bce1576 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:24:10.464631 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e448ef47-0d4f-489b-98fd-292b9bce1576 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 404 len: 111 microversion: 2.1 time: 0.037227 Jul 07 07:24:10.464631 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 256/519] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:10 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:24:10.481538 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bcf642e3-9db5-47ea-afe7-224d45c310c1 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '.version_select at 0x7fccfa098c10>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:10.505128 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bcf642e3-9db5-47ea-afe7-224d45c310c1 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-245216453" status: 202 len: 0 microversion: 2.1 time: 0.037492 Jul 07 07:24:10.506094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 264/520] 10.222.0.62 () {58 vars in 1217 bytes} [Thu Jul 7 07:24:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-245216453 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:24:11.195199 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-23996046-60a5-40cd-b412-da046ede8222 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: .version_select at 0x7fccfa25af70>, body: {"keypair": {"name": "tempest-keypair-527042178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAI6r1mz3QBO+7EEAT1F3J1fIZJ1f9su9hTj5sV5Hggu4Mz/xiulUTuR5au3nlDhQdZ7T59Lkue5bjTWoQySoZBO3Wefik/KnjcznswCWgO+3G+wfswiPSUJv8jECMMEJA=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:11.210021 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-23996046-60a5-40cd-b412-da046ede8222 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for project 883f7310b404427fa3ddda37a8d04acc. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:24:11.213632 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-23996046-60a5-40cd-b412-da046ede8222 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for user 58366850e234491cafe268bb56e9e3a1 and project 883f7310b404427fa3ddda37a8d04acc. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:24:11.236261 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-23996046-60a5-40cd-b412-da046ede8222 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045005 Jul 07 07:24:11.236925 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 257/521] 10.222.0.62 () {60 vars in 1158 bytes} [Thu Jul 7 07:24:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:12.635495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-208568688", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9578812b-5d60-45a0-af5c-eccba67aa04b"}], "security_groups": [{"name": "tempest-securitygroup--80503012"}], "key_name": "tempest-keypair-527042178", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:12.740550 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] validate_networks() for [('9578812b-5d60-45a0-af5c-eccba67aa04b', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:24:13.148169 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:24:13.148630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:24:13.149078 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:24:13.149557 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:24:13.149970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:24:13.159511 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:13.159958 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:13.160772 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:13.161205 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:13.179941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for project 883f7310b404427fa3ddda37a8d04acc. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:24:13.184740 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for user 58366850e234491cafe268bb56e9e3a1 and project 883f7310b404427fa3ddda37a8d04acc. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:24:13.198252 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:24:13.200696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:24:13.252997 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1350b892-90dc-4192-a52b-fda676717c10 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.621980 Jul 07 07:24:13.254470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 265/522] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:24:12 2022] POST /compute/v2.1/servers => generated 400 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:24:13.267640 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e1b35bb0-0c68-41f4-9ef4-85c66ea3e532 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:13.270709 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e1b35bb0-0c68-41f4-9ef4-85c66ea3e532 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:13.340643 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e1b35bb0-0c68-41f4-9ef4-85c66ea3e532 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:13.347933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e1b35bb0-0c68-41f4-9ef4-85c66ea3e532 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1240 microversion: 2.1 time: 0.086427 Jul 07 07:24:13.349396 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 258/523] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:13 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:14.368057 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c6e454ec-44fe-4f7b-a2e5-b6042bf6c10e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:14.369475 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c6e454ec-44fe-4f7b-a2e5-b6042bf6c10e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:14.376822 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6e454ec-44fe-4f7b-a2e5-b6042bf6c10e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:14.377395 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6e454ec-44fe-4f7b-a2e5-b6042bf6c10e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:14.378377 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6e454ec-44fe-4f7b-a2e5-b6042bf6c10e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:14.379084 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c6e454ec-44fe-4f7b-a2e5-b6042bf6c10e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:14.457341 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c6e454ec-44fe-4f7b-a2e5-b6042bf6c10e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:14.467091 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c6e454ec-44fe-4f7b-a2e5-b6042bf6c10e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1292 microversion: 2.1 time: 0.104349 Jul 07 07:24:14.467675 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 266/524] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:14 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:15.485790 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ad8672a6-c387-49f3-839c-2d3daccbf3a3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:15.486464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ad8672a6-c387-49f3-839c-2d3daccbf3a3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:15.494489 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad8672a6-c387-49f3-839c-2d3daccbf3a3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:15.495225 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad8672a6-c387-49f3-839c-2d3daccbf3a3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:15.496232 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad8672a6-c387-49f3-839c-2d3daccbf3a3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:15.496867 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ad8672a6-c387-49f3-839c-2d3daccbf3a3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:15.653690 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ad8672a6-c387-49f3-839c-2d3daccbf3a3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:15.662069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ad8672a6-c387-49f3-839c-2d3daccbf3a3 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1364 microversion: 2.1 time: 0.180634 Jul 07 07:24:15.662852 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 259/525] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:15 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:16.133771 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-8a76ad23-0c3f-4399-90ba-55d892d0021a req-8a1246d8-3a15-470a-a884-c86f9f5e1887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63316553-0499-415e-82f5-27b303818561", "tag": "48b2b8dd-3bb8-4d74-aa11-38876170e713"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:16.144472 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-8a76ad23-0c3f-4399-90ba-55d892d0021a req-8a1246d8-3a15-470a-a884-c86f9f5e1887 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:16.145208 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-8a76ad23-0c3f-4399-90ba-55d892d0021a req-8a1246d8-3a15-470a-a884-c86f9f5e1887 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:16.159638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-8a76ad23-0c3f-4399-90ba-55d892d0021a req-8a1246d8-3a15-470a-a884-c86f9f5e1887 service nova] Creating event network-changed:48b2b8dd-3bb8-4d74-aa11-38876170e713 for instance 63316553-0499-415e-82f5-27b303818561 on hv-cinder-82660 Jul 07 07:24:16.165250 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-8a76ad23-0c3f-4399-90ba-55d892d0021a req-8a1246d8-3a15-470a-a884-c86f9f5e1887 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035604 Jul 07 07:24:16.166017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 267/526] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:16.680647 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-82aab66f-81f1-4c68-8bed-01dfc434a651 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:16.681211 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-82aab66f-81f1-4c68-8bed-01dfc434a651 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:16.688402 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82aab66f-81f1-4c68-8bed-01dfc434a651 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:16.688858 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82aab66f-81f1-4c68-8bed-01dfc434a651 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:16.689748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82aab66f-81f1-4c68-8bed-01dfc434a651 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:16.690187 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82aab66f-81f1-4c68-8bed-01dfc434a651 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:16.846277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-82aab66f-81f1-4c68-8bed-01dfc434a651 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:16.854297 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-82aab66f-81f1-4c68-8bed-01dfc434a651 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1364 microversion: 2.1 time: 0.177828 Jul 07 07:24:16.854895 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 260/527] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:16 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:17.877794 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1dabedbd-1ed6-4538-b033-3cc20e2861dc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:17.880649 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1dabedbd-1ed6-4538-b033-3cc20e2861dc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:17.891214 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1dabedbd-1ed6-4538-b033-3cc20e2861dc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:17.891760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1dabedbd-1ed6-4538-b033-3cc20e2861dc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:17.893059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1dabedbd-1ed6-4538-b033-3cc20e2861dc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:17.893632 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1dabedbd-1ed6-4538-b033-3cc20e2861dc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:17.918246 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:18.051032 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1dabedbd-1ed6-4538-b033-3cc20e2861dc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:18.059326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1dabedbd-1ed6-4538-b033-3cc20e2861dc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1364 microversion: 2.1 time: 0.190769 Jul 07 07:24:18.059939 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 268/528] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:17 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:19.077036 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-639f2db6-aef9-417a-9b2e-49bc3f515cc2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:19.077765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-639f2db6-aef9-417a-9b2e-49bc3f515cc2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:19.084511 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-639f2db6-aef9-417a-9b2e-49bc3f515cc2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:19.084973 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-639f2db6-aef9-417a-9b2e-49bc3f515cc2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:19.085781 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-639f2db6-aef9-417a-9b2e-49bc3f515cc2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:19.086207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-639f2db6-aef9-417a-9b2e-49bc3f515cc2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:19.123919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d5e57284-2d15-4d58-9537-c8c80b682ce5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:19.126134 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d5e57284-2d15-4d58-9537-c8c80b682ce5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:19.136999 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5e57284-2d15-4d58-9537-c8c80b682ce5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:19.137663 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5e57284-2d15-4d58-9537-c8c80b682ce5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:19.139325 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5e57284-2d15-4d58-9537-c8c80b682ce5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:19.140010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d5e57284-2d15-4d58-9537-c8c80b682ce5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:19.350589 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-639f2db6-aef9-417a-9b2e-49bc3f515cc2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:19.357856 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d5e57284-2d15-4d58-9537-c8c80b682ce5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:19.358504 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-639f2db6-aef9-417a-9b2e-49bc3f515cc2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1364 microversion: 2.1 time: 0.285519 Jul 07 07:24:19.359083 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 261/529] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:19 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:19.366109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d5e57284-2d15-4d58-9537-c8c80b682ce5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1593 microversion: 2.1 time: 0.249408 Jul 07 07:24:19.366754 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 269/530] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:19 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1593 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:24:20.371142 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3c8295a8-adec-4502-bb35-fc14471d8e3a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2d187e9-633c-4355-bd32-4e5780cc6735"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:20.373197 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3c8295a8-adec-4502-bb35-fc14471d8e3a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:20.375454 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fde9ae9f-53f5-451c-a4d4-ca224db51a1b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:20.376733 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fde9ae9f-53f5-451c-a4d4-ca224db51a1b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:20.380902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c8295a8-adec-4502-bb35-fc14471d8e3a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:20.381393 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c8295a8-adec-4502-bb35-fc14471d8e3a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:20.382482 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c8295a8-adec-4502-bb35-fc14471d8e3a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:20.383180 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c8295a8-adec-4502-bb35-fc14471d8e3a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:20.386410 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fde9ae9f-53f5-451c-a4d4-ca224db51a1b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:20.390700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:20.394017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fde9ae9f-53f5-451c-a4d4-ca224db51a1b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:20.395409 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fde9ae9f-53f5-451c-a4d4-ca224db51a1b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:20.395914 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fde9ae9f-53f5-451c-a4d4-ca224db51a1b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:20.571308 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fde9ae9f-53f5-451c-a4d4-ca224db51a1b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:20.580055 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fde9ae9f-53f5-451c-a4d4-ca224db51a1b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1364 microversion: 2.1 time: 0.208522 Jul 07 07:24:20.580638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 270/531] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:20 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:20.737408 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3c8295a8-adec-4502-bb35-fc14471d8e3a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372322 Jul 07 07:24:20.738087 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 262/532] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:24:20 2022] POST /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:21.418073 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-9dfa597b-989c-480a-bf89-ae1d1c1f7455 req-29b2dc4e-1821-4eb1-9d96-7da66de42959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e219f102-9056-42d4-86fd-4a0f8348d041", "tag": "93dad3d5-bbb3-4950-91cc-7f4d0c71fe54"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:21.425135 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-9dfa597b-989c-480a-bf89-ae1d1c1f7455 req-29b2dc4e-1821-4eb1-9d96-7da66de42959 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:21.425672 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-9dfa597b-989c-480a-bf89-ae1d1c1f7455 req-29b2dc4e-1821-4eb1-9d96-7da66de42959 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:21.439382 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-9dfa597b-989c-480a-bf89-ae1d1c1f7455 req-29b2dc4e-1821-4eb1-9d96-7da66de42959 service nova] Creating event network-changed:93dad3d5-bbb3-4950-91cc-7f4d0c71fe54 for instance e219f102-9056-42d4-86fd-4a0f8348d041 on hv-cinder-82660 Jul 07 07:24:21.444704 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-9dfa597b-989c-480a-bf89-ae1d1c1f7455 req-29b2dc4e-1821-4eb1-9d96-7da66de42959 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033217 Jul 07 07:24:21.449399 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 271/533] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:21.599841 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b92a6b49-8ec8-4f26-aea6-65d28cc418c8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:21.601797 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b92a6b49-8ec8-4f26-aea6-65d28cc418c8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:21.610178 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b92a6b49-8ec8-4f26-aea6-65d28cc418c8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:21.611072 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b92a6b49-8ec8-4f26-aea6-65d28cc418c8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:21.612911 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b92a6b49-8ec8-4f26-aea6-65d28cc418c8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:21.614023 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b92a6b49-8ec8-4f26-aea6-65d28cc418c8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:21.816947 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b92a6b49-8ec8-4f26-aea6-65d28cc418c8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:21.828572 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b92a6b49-8ec8-4f26-aea6-65d28cc418c8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1364 microversion: 2.1 time: 0.234809 Jul 07 07:24:21.829831 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 263/534] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:21 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:22.065632 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-24eb0932-c717-4391-8939-48e35c27332a req-f04d886c-9c81-4978-baca-89e7dd8f53e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63316553-0499-415e-82f5-27b303818561", "name": "network-vif-plugged", "status": "completed", "tag": "48b2b8dd-3bb8-4d74-aa11-38876170e713"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:22.075728 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-24eb0932-c717-4391-8939-48e35c27332a req-f04d886c-9c81-4978-baca-89e7dd8f53e7 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:22.076409 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-24eb0932-c717-4391-8939-48e35c27332a req-f04d886c-9c81-4978-baca-89e7dd8f53e7 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:22.092451 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-24eb0932-c717-4391-8939-48e35c27332a req-f04d886c-9c81-4978-baca-89e7dd8f53e7 service nova] Creating event network-vif-plugged:48b2b8dd-3bb8-4d74-aa11-38876170e713 for instance 63316553-0499-415e-82f5-27b303818561 on hv-cinder-82660 Jul 07 07:24:22.101464 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-24eb0932-c717-4391-8939-48e35c27332a req-f04d886c-9c81-4978-baca-89e7dd8f53e7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045646 Jul 07 07:24:22.102836 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 272/535] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:22.653940 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fee628e0-17eb-4a53-94b6-697a94d4f9a8 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-510580042"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:22.655198 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fee628e0-17eb-4a53-94b6-697a94d4f9a8 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:22.663672 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fee628e0-17eb-4a53-94b6-697a94d4f9a8 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:22.664675 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fee628e0-17eb-4a53-94b6-697a94d4f9a8 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:22.665802 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fee628e0-17eb-4a53-94b6-697a94d4f9a8 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:22.666464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fee628e0-17eb-4a53-94b6-697a94d4f9a8 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:22.812316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.network.security_group_api [None req-fee628e0-17eb-4a53-94b6-697a94d4f9a8 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Adding security group aa505b4d-5ad6-4038-b5b3-26084781bb0b to port 93dad3d5-bbb3-4950-91cc-7f4d0c71fe54 Jul 07 07:24:22.847041 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-36b1efe7-04e0-43a0-9993-d59648508ba6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:22.848201 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-36b1efe7-04e0-43a0-9993-d59648508ba6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:22.855757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36b1efe7-04e0-43a0-9993-d59648508ba6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:22.856560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36b1efe7-04e0-43a0-9993-d59648508ba6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:22.857464 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36b1efe7-04e0-43a0-9993-d59648508ba6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:22.857953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36b1efe7-04e0-43a0-9993-d59648508ba6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:23.098636 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-36b1efe7-04e0-43a0-9993-d59648508ba6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:23.107033 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-36b1efe7-04e0-43a0-9993-d59648508ba6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1364 microversion: 2.1 time: 0.264394 Jul 07 07:24:23.107586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 273/536] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:22 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:24:23.291078 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fee628e0-17eb-4a53-94b6-697a94d4f9a8 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "POST /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/action" status: 202 len: 0 microversion: 2.1 time: 0.641173 Jul 07 07:24:23.291679 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 264/537] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:24:22 2022] POST /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:24:23.299982 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-a1d85b22-3b3a-4fd5-8385-9c5efc147745 req-c17754e2-0830-41cc-ac0f-0a89154c7d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e219f102-9056-42d4-86fd-4a0f8348d041", "tag": "93dad3d5-bbb3-4950-91cc-7f4d0c71fe54"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:23.301729 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3aa09ed0-5e56-4a99-bea9-b25fdedc5e57 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:23.302595 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3aa09ed0-5e56-4a99-bea9-b25fdedc5e57 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:23.306237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:23.307781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:23.314329 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3aa09ed0-5e56-4a99-bea9-b25fdedc5e57 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:23.314796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3aa09ed0-5e56-4a99-bea9-b25fdedc5e57 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:23.315737 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3aa09ed0-5e56-4a99-bea9-b25fdedc5e57 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:23.315879 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a1d85b22-3b3a-4fd5-8385-9c5efc147745 req-c17754e2-0830-41cc-ac0f-0a89154c7d7d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:23.316172 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3aa09ed0-5e56-4a99-bea9-b25fdedc5e57 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:23.316565 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a1d85b22-3b3a-4fd5-8385-9c5efc147745 req-c17754e2-0830-41cc-ac0f-0a89154c7d7d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:23.345697 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-a1d85b22-3b3a-4fd5-8385-9c5efc147745 req-c17754e2-0830-41cc-ac0f-0a89154c7d7d service nova] Creating event network-changed:93dad3d5-bbb3-4950-91cc-7f4d0c71fe54 for instance e219f102-9056-42d4-86fd-4a0f8348d041 on hv-cinder-82660 Jul 07 07:24:23.354163 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-a1d85b22-3b3a-4fd5-8385-9c5efc147745 req-c17754e2-0830-41cc-ac0f-0a89154c7d7d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057221 Jul 07 07:24:23.355635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 274/538] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:24:23.359870 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:23.512174 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3aa09ed0-5e56-4a99-bea9-b25fdedc5e57 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:23.521696 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3aa09ed0-5e56-4a99-bea9-b25fdedc5e57 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1758 microversion: 2.1 time: 0.224979 Jul 07 07:24:23.522273 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 265/539] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:23 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1758 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:24.124731 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4520d5bb-be9e-497c-af98-8fd9c55721d7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:24.125463 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4520d5bb-be9e-497c-af98-8fd9c55721d7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:24.132689 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4520d5bb-be9e-497c-af98-8fd9c55721d7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:24.133068 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4520d5bb-be9e-497c-af98-8fd9c55721d7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:24.133899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4520d5bb-be9e-497c-af98-8fd9c55721d7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:24.134337 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4520d5bb-be9e-497c-af98-8fd9c55721d7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:24.279333 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4520d5bb-be9e-497c-af98-8fd9c55721d7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:24.287490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4520d5bb-be9e-497c-af98-8fd9c55721d7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1364 microversion: 2.1 time: 0.167020 Jul 07 07:24:24.288080 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 275/540] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:24 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:25.308076 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1c23803a-9bbd-4edd-b67f-edcdb9811af6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:25.308791 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1c23803a-9bbd-4edd-b67f-edcdb9811af6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:25.318995 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c23803a-9bbd-4edd-b67f-edcdb9811af6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:25.319580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c23803a-9bbd-4edd-b67f-edcdb9811af6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:25.320366 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c23803a-9bbd-4edd-b67f-edcdb9811af6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:25.320796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c23803a-9bbd-4edd-b67f-edcdb9811af6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:25.467661 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1c23803a-9bbd-4edd-b67f-edcdb9811af6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:25.478976 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1c23803a-9bbd-4edd-b67f-edcdb9811af6 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1554 microversion: 2.1 time: 0.176616 Jul 07 07:24:25.479714 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 266/541] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:25 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:25.497926 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9bf5d417-28c5-4f4a-bb62-47dcbf82f44c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:25.498448 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9bf5d417-28c5-4f4a-bb62-47dcbf82f44c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:25.505136 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9bf5d417-28c5-4f4a-bb62-47dcbf82f44c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:25.505616 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9bf5d417-28c5-4f4a-bb62-47dcbf82f44c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:25.506374 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9bf5d417-28c5-4f4a-bb62-47dcbf82f44c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:25.506822 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9bf5d417-28c5-4f4a-bb62-47dcbf82f44c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:25.820060 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9bf5d417-28c5-4f4a-bb62-47dcbf82f44c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.326011 Jul 07 07:24:25.820667 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 276/542] 10.222.0.62 () {58 vars in 1274 bytes} [Thu Jul 7 07:24:25 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-interface => generated 285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:26.817475 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-505abcf5-e8ee-426b-8455-683bcc21e9e5 req-e06a543a-214f-4535-8854-d8a46cc6d88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63316553-0499-415e-82f5-27b303818561", "tag": "48b2b8dd-3bb8-4d74-aa11-38876170e713"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:26.826800 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-505abcf5-e8ee-426b-8455-683bcc21e9e5 req-e06a543a-214f-4535-8854-d8a46cc6d88c service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:26.827352 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-505abcf5-e8ee-426b-8455-683bcc21e9e5 req-e06a543a-214f-4535-8854-d8a46cc6d88c service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:26.840523 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-505abcf5-e8ee-426b-8455-683bcc21e9e5 req-e06a543a-214f-4535-8854-d8a46cc6d88c service nova] Creating event network-changed:48b2b8dd-3bb8-4d74-aa11-38876170e713 for instance 63316553-0499-415e-82f5-27b303818561 on hv-cinder-82660 Jul 07 07:24:26.846421 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-505abcf5-e8ee-426b-8455-683bcc21e9e5 req-e06a543a-214f-4535-8854-d8a46cc6d88c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032773 Jul 07 07:24:26.847175 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 267/543] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:28.343237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-36a722e8-36e9-49d7-8d30-3a37e6e9fbbb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:28.344576 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-36a722e8-36e9-49d7-8d30-3a37e6e9fbbb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:28.351410 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36a722e8-36e9-49d7-8d30-3a37e6e9fbbb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:28.351854 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36a722e8-36e9-49d7-8d30-3a37e6e9fbbb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:28.352641 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36a722e8-36e9-49d7-8d30-3a37e6e9fbbb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:28.353094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36a722e8-36e9-49d7-8d30-3a37e6e9fbbb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:28.382174 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-36a722e8-36e9-49d7-8d30-3a37e6e9fbbb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lazy-loading 'flavor' on Instance uuid c68b9418-cc4f-41da-8dba-1ef31555120e {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:24:28.514334 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-36a722e8-36e9-49d7-8d30-3a37e6e9fbbb tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/action" status: 200 len: 32 microversion: 2.1 time: 0.177661 Jul 07 07:24:28.514964 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 277/544] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:24:28 2022] POST /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 07 07:24:28.525303 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-56d5bf56-418f-4234-ad9c-de4cbe1765d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:28.525994 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-56d5bf56-418f-4234-ad9c-de4cbe1765d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:28.528786 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:28.534774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56d5bf56-418f-4234-ad9c-de4cbe1765d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:28.535215 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56d5bf56-418f-4234-ad9c-de4cbe1765d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:28.535985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56d5bf56-418f-4234-ad9c-de4cbe1765d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:28.536411 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-56d5bf56-418f-4234-ad9c-de4cbe1765d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:28.676297 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-56d5bf56-418f-4234-ad9c-de4cbe1765d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:28.685312 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-56d5bf56-418f-4234-ad9c-de4cbe1765d6 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.164267 Jul 07 07:24:28.686059 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 268/545] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:28 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:29.703808 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d6866166-296c-45b5-8be5-943c428ae03a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:29.704504 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d6866166-296c-45b5-8be5-943c428ae03a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:29.706540 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:29.713469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6866166-296c-45b5-8be5-943c428ae03a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:29.713928 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6866166-296c-45b5-8be5-943c428ae03a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:29.714717 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6866166-296c-45b5-8be5-943c428ae03a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:29.715139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d6866166-296c-45b5-8be5-943c428ae03a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:29.857284 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d6866166-296c-45b5-8be5-943c428ae03a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:29.869704 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d6866166-296c-45b5-8be5-943c428ae03a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.170375 Jul 07 07:24:29.870628 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 278/546] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:29 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:30.889697 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a2018e4c-9d68-493d-a16f-4066d90d5497 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:30.890320 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a2018e4c-9d68-493d-a16f-4066d90d5497 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:30.897543 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2018e4c-9d68-493d-a16f-4066d90d5497 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:30.897994 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2018e4c-9d68-493d-a16f-4066d90d5497 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:30.898778 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2018e4c-9d68-493d-a16f-4066d90d5497 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:30.899183 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2018e4c-9d68-493d-a16f-4066d90d5497 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:31.039679 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a2018e4c-9d68-493d-a16f-4066d90d5497 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:31.048095 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a2018e4c-9d68-493d-a16f-4066d90d5497 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.162421 Jul 07 07:24:31.048663 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 269/547] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:30 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:32.066376 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-02748691-51c9-4b7f-a13e-614cc15cda38 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:32.066978 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-02748691-51c9-4b7f-a13e-614cc15cda38 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:32.074056 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02748691-51c9-4b7f-a13e-614cc15cda38 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:32.074508 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02748691-51c9-4b7f-a13e-614cc15cda38 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:32.075271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02748691-51c9-4b7f-a13e-614cc15cda38 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:32.075701 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-02748691-51c9-4b7f-a13e-614cc15cda38 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:32.217026 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-02748691-51c9-4b7f-a13e-614cc15cda38 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:32.230058 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-02748691-51c9-4b7f-a13e-614cc15cda38 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.167395 Jul 07 07:24:32.230881 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 279/548] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:32 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:33.250396 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0d5e89ab-2b1f-4a02-a8cb-c206321e3eb1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:33.250962 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0d5e89ab-2b1f-4a02-a8cb-c206321e3eb1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:33.259585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d5e89ab-2b1f-4a02-a8cb-c206321e3eb1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:33.260144 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d5e89ab-2b1f-4a02-a8cb-c206321e3eb1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:33.261312 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d5e89ab-2b1f-4a02-a8cb-c206321e3eb1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:33.261904 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d5e89ab-2b1f-4a02-a8cb-c206321e3eb1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:33.406187 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0d5e89ab-2b1f-4a02-a8cb-c206321e3eb1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:33.414728 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0d5e89ab-2b1f-4a02-a8cb-c206321e3eb1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.168888 Jul 07 07:24:33.415315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 270/549] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:33 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:34.432163 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1cb1f81f-2677-4b68-ab8b-4aadc4022ede tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:34.432771 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1cb1f81f-2677-4b68-ab8b-4aadc4022ede tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:34.440241 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1cb1f81f-2677-4b68-ab8b-4aadc4022ede tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:34.440691 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1cb1f81f-2677-4b68-ab8b-4aadc4022ede tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:34.441498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1cb1f81f-2677-4b68-ab8b-4aadc4022ede tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:34.441934 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1cb1f81f-2677-4b68-ab8b-4aadc4022ede tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:34.588339 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1cb1f81f-2677-4b68-ab8b-4aadc4022ede tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:34.601636 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1cb1f81f-2677-4b68-ab8b-4aadc4022ede tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.173103 Jul 07 07:24:34.602473 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 280/550] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:34 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:35.625656 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3d80904a-9e4f-42cd-935e-256b15626d81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:35.626547 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3d80904a-9e4f-42cd-935e-256b15626d81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:35.634287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d80904a-9e4f-42cd-935e-256b15626d81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:35.634765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d80904a-9e4f-42cd-935e-256b15626d81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:35.635545 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d80904a-9e4f-42cd-935e-256b15626d81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:35.635979 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3d80904a-9e4f-42cd-935e-256b15626d81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:35.787229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3d80904a-9e4f-42cd-935e-256b15626d81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:35.795957 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3d80904a-9e4f-42cd-935e-256b15626d81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.176874 Jul 07 07:24:35.796569 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 271/551] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:35 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:36.814153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9550d639-d8ac-49e1-926b-2e0c1404a120 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:36.814809 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9550d639-d8ac-49e1-926b-2e0c1404a120 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:36.822308 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9550d639-d8ac-49e1-926b-2e0c1404a120 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:36.822813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9550d639-d8ac-49e1-926b-2e0c1404a120 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:36.823604 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9550d639-d8ac-49e1-926b-2e0c1404a120 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:36.824061 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9550d639-d8ac-49e1-926b-2e0c1404a120 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:36.960691 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9550d639-d8ac-49e1-926b-2e0c1404a120 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:36.970063 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9550d639-d8ac-49e1-926b-2e0c1404a120 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.160286 Jul 07 07:24:36.970544 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 281/552] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:36 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:37.990885 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7e8dcf99-c4d5-4957-aed3-6ecb8dcba77a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:37.991516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7e8dcf99-c4d5-4957-aed3-6ecb8dcba77a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:38.001777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e8dcf99-c4d5-4957-aed3-6ecb8dcba77a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:38.002384 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e8dcf99-c4d5-4957-aed3-6ecb8dcba77a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:38.003161 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e8dcf99-c4d5-4957-aed3-6ecb8dcba77a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:38.003602 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7e8dcf99-c4d5-4957-aed3-6ecb8dcba77a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:38.136260 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7e8dcf99-c4d5-4957-aed3-6ecb8dcba77a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:38.148715 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7e8dcf99-c4d5-4957-aed3-6ecb8dcba77a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.163557 Jul 07 07:24:38.149743 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 272/553] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:37 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:39.166944 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d85d0e72-217e-456b-88c6-b1fc50ab0a63 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:39.167558 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d85d0e72-217e-456b-88c6-b1fc50ab0a63 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:39.174953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d85d0e72-217e-456b-88c6-b1fc50ab0a63 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:39.175406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d85d0e72-217e-456b-88c6-b1fc50ab0a63 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:39.176181 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d85d0e72-217e-456b-88c6-b1fc50ab0a63 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:39.176612 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d85d0e72-217e-456b-88c6-b1fc50ab0a63 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:39.324311 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d85d0e72-217e-456b-88c6-b1fc50ab0a63 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:39.334205 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d85d0e72-217e-456b-88c6-b1fc50ab0a63 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.170819 Jul 07 07:24:39.334798 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 282/554] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:39 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:40.354766 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3c299c47-ab52-4cf9-9347-7644242cac9e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:40.355358 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3c299c47-ab52-4cf9-9347-7644242cac9e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:40.362979 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c299c47-ab52-4cf9-9347-7644242cac9e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:40.363425 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c299c47-ab52-4cf9-9347-7644242cac9e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:40.364210 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c299c47-ab52-4cf9-9347-7644242cac9e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:40.364650 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3c299c47-ab52-4cf9-9347-7644242cac9e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:40.499548 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3c299c47-ab52-4cf9-9347-7644242cac9e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:40.512849 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3c299c47-ab52-4cf9-9347-7644242cac9e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.161939 Jul 07 07:24:40.513469 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 273/555] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:40 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:41.535435 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5edd227d-b61f-478e-8f28-32046bbf5c06 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:41.535975 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5edd227d-b61f-478e-8f28-32046bbf5c06 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:41.542923 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5edd227d-b61f-478e-8f28-32046bbf5c06 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:41.543379 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5edd227d-b61f-478e-8f28-32046bbf5c06 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:41.544148 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5edd227d-b61f-478e-8f28-32046bbf5c06 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:41.544586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5edd227d-b61f-478e-8f28-32046bbf5c06 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:41.690387 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5edd227d-b61f-478e-8f28-32046bbf5c06 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:41.698549 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5edd227d-b61f-478e-8f28-32046bbf5c06 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.169217 Jul 07 07:24:41.699148 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 283/556] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:41 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:42.718880 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-04c62928-b560-439e-a8b9-21d12fd358b7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:42.719555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-04c62928-b560-439e-a8b9-21d12fd358b7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:42.729445 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04c62928-b560-439e-a8b9-21d12fd358b7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:42.730083 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04c62928-b560-439e-a8b9-21d12fd358b7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:42.731221 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04c62928-b560-439e-a8b9-21d12fd358b7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:42.731799 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-04c62928-b560-439e-a8b9-21d12fd358b7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:42.877412 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-04c62928-b560-439e-a8b9-21d12fd358b7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:42.895530 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-04c62928-b560-439e-a8b9-21d12fd358b7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.182402 Jul 07 07:24:42.896126 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 274/557] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:42 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:43.913925 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b59d9398-56d7-4717-bed1-ef797783d9f8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:43.914527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b59d9398-56d7-4717-bed1-ef797783d9f8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:43.921768 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b59d9398-56d7-4717-bed1-ef797783d9f8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:43.922213 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b59d9398-56d7-4717-bed1-ef797783d9f8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:43.922989 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b59d9398-56d7-4717-bed1-ef797783d9f8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:43.923396 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b59d9398-56d7-4717-bed1-ef797783d9f8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:44.065193 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b59d9398-56d7-4717-bed1-ef797783d9f8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:44.073682 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b59d9398-56d7-4717-bed1-ef797783d9f8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.163705 Jul 07 07:24:44.074558 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 284/558] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:43 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:45.091778 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dee13367-db97-4e1f-9bc3-0f5a61e984ea tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:45.092409 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dee13367-db97-4e1f-9bc3-0f5a61e984ea tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:45.101164 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dee13367-db97-4e1f-9bc3-0f5a61e984ea tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:45.101858 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dee13367-db97-4e1f-9bc3-0f5a61e984ea tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:45.102994 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dee13367-db97-4e1f-9bc3-0f5a61e984ea tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:45.103559 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dee13367-db97-4e1f-9bc3-0f5a61e984ea tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:45.239636 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dee13367-db97-4e1f-9bc3-0f5a61e984ea tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:45.247806 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dee13367-db97-4e1f-9bc3-0f5a61e984ea tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.160217 Jul 07 07:24:45.248362 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 275/559] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:45 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:46.270290 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-79d01a0a-389e-4bf5-ad16-92959b3a6677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:46.271094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-79d01a0a-389e-4bf5-ad16-92959b3a6677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:46.282694 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79d01a0a-389e-4bf5-ad16-92959b3a6677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:46.283470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79d01a0a-389e-4bf5-ad16-92959b3a6677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:46.284715 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79d01a0a-389e-4bf5-ad16-92959b3a6677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:46.285155 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79d01a0a-389e-4bf5-ad16-92959b3a6677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:46.304015 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:46.429095 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-79d01a0a-389e-4bf5-ad16-92959b3a6677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:46.441953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-79d01a0a-389e-4bf5-ad16-92959b3a6677 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.178033 Jul 07 07:24:46.443586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 285/560] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:46 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:47.464330 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-185348f7-b816-45bd-946d-9b11b20688ed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:47.464907 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-185348f7-b816-45bd-946d-9b11b20688ed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:47.471945 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-185348f7-b816-45bd-946d-9b11b20688ed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:47.472388 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-185348f7-b816-45bd-946d-9b11b20688ed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:47.473183 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-185348f7-b816-45bd-946d-9b11b20688ed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:47.473640 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-185348f7-b816-45bd-946d-9b11b20688ed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:47.614524 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-185348f7-b816-45bd-946d-9b11b20688ed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:47.627297 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-185348f7-b816-45bd-946d-9b11b20688ed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1736 microversion: 2.1 time: 0.166681 Jul 07 07:24:47.628153 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 276/561] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:47 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:48.644774 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d7bd6ec5-e0d1-45b1-b13d-4d0180876af1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:48.645382 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d7bd6ec5-e0d1-45b1-b13d-4d0180876af1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:48.657662 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7bd6ec5-e0d1-45b1-b13d-4d0180876af1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:48.658165 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7bd6ec5-e0d1-45b1-b13d-4d0180876af1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:48.659068 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7bd6ec5-e0d1-45b1-b13d-4d0180876af1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:48.659548 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d7bd6ec5-e0d1-45b1-b13d-4d0180876af1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:48.804629 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d7bd6ec5-e0d1-45b1-b13d-4d0180876af1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:48.813441 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d7bd6ec5-e0d1-45b1-b13d-4d0180876af1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1716 microversion: 2.1 time: 0.172836 Jul 07 07:24:48.814012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 286/562] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:48 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1716 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:48.933834 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-65b8761c-1e73-48ae-9198-398f60dbcff1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:48.934581 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-65b8761c-1e73-48ae-9198-398f60dbcff1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:48.943161 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65b8761c-1e73-48ae-9198-398f60dbcff1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:48.943851 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65b8761c-1e73-48ae-9198-398f60dbcff1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:48.945015 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65b8761c-1e73-48ae-9198-398f60dbcff1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:48.945622 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-65b8761c-1e73-48ae-9198-398f60dbcff1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:49.039328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-65b8761c-1e73-48ae-9198-398f60dbcff1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] HTTP exception thrown: Cannot 'detach_volume' instance c68b9418-cc4f-41da-8dba-1ef31555120e while it is in vm_state rescued Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-65b8761c-1e73-48ae-9198-398f60dbcff1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Request method failure captured: Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments/d2d187e9-633c-4355-bd32-4e5780cc6735 HTTP/1.1 Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixomBgYKq99kztrIf-WXBT-oxXPLtswlcfUwVT_4CumoXbRkjjrZnfPLDoVDrFcuZtG6MmBwoFMiMVriYFP69L1sx8H6oqVwqo5FsA2CCk7qzym3IjG9WkQtWXfpG23zk0wtp5Enbd45xiS0O04WrCwexa1Gjm6jabSe4F855x7F4yTU Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 441079c8bc1b4a4fb8f38fff6728f3ef Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:24:49.040954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 441079c8bc1b4a4fb8f38fff6728f3ef Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-ServerRescueNegativeTestJSON-1796603694-project Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: b80ab2a9c7504806851400e07074004e Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796603694-project Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:24:49.042490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Cannot 'detach_volume' instance c68b9418-cc4f-41da-8dba-1ef31555120e while it is in vm_state rescued Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'server_id': 'c68b9418-cc4f-41da-8dba-1ef31555120e', 'id': 'd2d187e9-633c-4355-bd32-4e5780cc6735'} Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c68b9418-cc4f-41da-8dba-1ef31555120e in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:24:49.043316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c68b9418-cc4f-41da-8dba-1ef31555120e while it is in vm_state rescued Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c68b9418-cc4f-41da-8dba-1ef31555120e while it is in vm_state rescued Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:24:49.044765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-65b8761c-1e73-48ae-9198-398f60dbcff1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Returning 409 to user: Cannot 'detach_volume' instance c68b9418-cc4f-41da-8dba-1ef31555120e while it is in vm_state rescued {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:24:49.046009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-65b8761c-1e73-48ae-9198-398f60dbcff1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments/d2d187e9-633c-4355-bd32-4e5780cc6735" status: 409 len: 152 microversion: 2.1 time: 0.115086 Jul 07 07:24:49.046009 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 277/563] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:24:48 2022] DELETE /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments/d2d187e9-633c-4355-bd32-4e5780cc6735 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 07 07:24:49.051518 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7839dfe0-454b-4c83-bd66-b1dc62429520 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:49.052074 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7839dfe0-454b-4c83-bd66-b1dc62429520 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:49.058816 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7839dfe0-454b-4c83-bd66-b1dc62429520 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:49.059318 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7839dfe0-454b-4c83-bd66-b1dc62429520 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:49.060331 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7839dfe0-454b-4c83-bd66-b1dc62429520 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:49.060763 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7839dfe0-454b-4c83-bd66-b1dc62429520 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:49.132582 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7839dfe0-454b-4c83-bd66-b1dc62429520 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "POST /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/action" status: 202 len: 0 microversion: 2.1 time: 0.084722 Jul 07 07:24:49.133745 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 287/564] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:24:49 2022] POST /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:24:49.159350 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dba1b294-05c3-468e-8831-12cdf607a3fa tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:49.160456 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dba1b294-05c3-468e-8831-12cdf607a3fa tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:49.169958 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dba1b294-05c3-468e-8831-12cdf607a3fa tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:49.170635 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dba1b294-05c3-468e-8831-12cdf607a3fa tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:49.171853 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dba1b294-05c3-468e-8831-12cdf607a3fa tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:49.172447 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dba1b294-05c3-468e-8831-12cdf607a3fa tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:49.192403 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:49.313047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dba1b294-05c3-468e-8831-12cdf607a3fa tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:49.321524 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dba1b294-05c3-468e-8831-12cdf607a3fa tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1724 microversion: 2.1 time: 0.181727 Jul 07 07:24:49.322099 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 278/565] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:49 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:50.340447 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cf177173-afae-40a2-8197-0554522ca792 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:50.341051 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cf177173-afae-40a2-8197-0554522ca792 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:50.348661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf177173-afae-40a2-8197-0554522ca792 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:50.349018 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf177173-afae-40a2-8197-0554522ca792 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:50.349854 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf177173-afae-40a2-8197-0554522ca792 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:50.350297 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cf177173-afae-40a2-8197-0554522ca792 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:50.481314 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cf177173-afae-40a2-8197-0554522ca792 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:50.490987 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cf177173-afae-40a2-8197-0554522ca792 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1724 microversion: 2.1 time: 0.154677 Jul 07 07:24:50.491799 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 288/566] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:50 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:50.579875 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e81d5d4-fe27-409c-b644-19719096b76c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:50.580495 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3e81d5d4-fe27-409c-b644-19719096b76c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:50.589443 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e81d5d4-fe27-409c-b644-19719096b76c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:50.589966 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e81d5d4-fe27-409c-b644-19719096b76c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:50.591137 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e81d5d4-fe27-409c-b644-19719096b76c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:50.591561 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e81d5d4-fe27-409c-b644-19719096b76c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:50.622717 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3e81d5d4-fe27-409c-b644-19719096b76c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments/490c1f63-45f4-4efa-9cec-d32b97dc595e" status: 200 len: 194 microversion: 2.20 time: 0.049351 Jul 07 07:24:50.623380 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 279/567] 10.222.0.62 () {60 vars in 1453 bytes} [Thu Jul 7 07:24:50 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments/490c1f63-45f4-4efa-9cec-d32b97dc595e => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:24:50.699225 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c8b06fcb-ebc9-4e2a-b3e5-99f0ffe22a61 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:50.699720 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c8b06fcb-ebc9-4e2a-b3e5-99f0ffe22a61 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:50.706337 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c8b06fcb-ebc9-4e2a-b3e5-99f0ffe22a61 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:50.706779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c8b06fcb-ebc9-4e2a-b3e5-99f0ffe22a61 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:50.707540 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c8b06fcb-ebc9-4e2a-b3e5-99f0ffe22a61 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:50.707974 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c8b06fcb-ebc9-4e2a-b3e5-99f0ffe22a61 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:50.787883 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-c8b06fcb-ebc9-4e2a-b3e5-99f0ffe22a61 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lazy-loading 'services' on Instance uuid 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:24:50.865603 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c8b06fcb-ebc9-4e2a-b3e5-99f0ffe22a61 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments/490c1f63-45f4-4efa-9cec-d32b97dc595e" status: 202 len: 0 microversion: 2.20 time: 0.170146 Jul 07 07:24:50.866197 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 289/568] 10.222.0.62 () {60 vars in 1456 bytes} [Thu Jul 7 07:24:50 2022] DELETE /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments/490c1f63-45f4-4efa-9cec-d32b97dc595e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:24:50.874675 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-698c5972-984f-4da1-be1b-5562f894a82e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:50.875663 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-698c5972-984f-4da1-be1b-5562f894a82e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:50.882166 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-698c5972-984f-4da1-be1b-5562f894a82e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:50.882615 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-698c5972-984f-4da1-be1b-5562f894a82e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:50.883383 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-698c5972-984f-4da1-be1b-5562f894a82e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:50.883837 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-698c5972-984f-4da1-be1b-5562f894a82e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:50.913865 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-698c5972-984f-4da1-be1b-5562f894a82e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043158 Jul 07 07:24:50.914407 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 280/569] 10.222.0.62 () {60 vars in 1342 bytes} [Thu Jul 7 07:24:50 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:24:51.510997 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-48292cd1-071f-4871-8044-6fe546be08d1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:51.511571 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-48292cd1-071f-4871-8044-6fe546be08d1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:51.518749 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48292cd1-071f-4871-8044-6fe546be08d1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:51.519192 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48292cd1-071f-4871-8044-6fe546be08d1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:51.519987 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48292cd1-071f-4871-8044-6fe546be08d1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:51.520414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48292cd1-071f-4871-8044-6fe546be08d1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:51.662608 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-48292cd1-071f-4871-8044-6fe546be08d1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:51.673800 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-48292cd1-071f-4871-8044-6fe546be08d1 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1724 microversion: 2.1 time: 0.167227 Jul 07 07:24:51.674929 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 290/570] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:51 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:51.926051 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-00ec3f14-5248-446a-8502-fbc5a8a56a29 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:51.927480 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-00ec3f14-5248-446a-8502-fbc5a8a56a29 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:51.934520 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00ec3f14-5248-446a-8502-fbc5a8a56a29 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:51.935271 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00ec3f14-5248-446a-8502-fbc5a8a56a29 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:51.936016 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00ec3f14-5248-446a-8502-fbc5a8a56a29 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:51.936449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00ec3f14-5248-446a-8502-fbc5a8a56a29 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:51.966933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-00ec3f14-5248-446a-8502-fbc5a8a56a29 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045341 Jul 07 07:24:51.967522 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 281/571] 10.222.0.62 () {60 vars in 1342 bytes} [Thu Jul 7 07:24:51 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:24:52.078663 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e3da495a-5b38-4b31-beb4-4cd10c1af564 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:52.080275 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e3da495a-5b38-4b31-beb4-4cd10c1af564 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:52.089419 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3da495a-5b38-4b31-beb4-4cd10c1af564 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.090090 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3da495a-5b38-4b31-beb4-4cd10c1af564 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.091495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3da495a-5b38-4b31-beb4-4cd10c1af564 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.091495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e3da495a-5b38-4b31-beb4-4cd10c1af564 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.122341 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e3da495a-5b38-4b31-beb4-4cd10c1af564 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049218 Jul 07 07:24:52.122854 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 291/572] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:24:52 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 07:24:52.191551 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0f17d217-e8b7-4abc-b692-4bda7c1681bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:52.192046 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0f17d217-e8b7-4abc-b692-4bda7c1681bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:52.198582 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f17d217-e8b7-4abc-b692-4bda7c1681bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.199038 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f17d217-e8b7-4abc-b692-4bda7c1681bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.199794 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f17d217-e8b7-4abc-b692-4bda7c1681bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.200233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0f17d217-e8b7-4abc-b692-4bda7c1681bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.228801 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0f17d217-e8b7-4abc-b692-4bda7c1681bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:24:52.309387 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0f17d217-e8b7-4abc-b692-4bda7c1681bf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 204 len: 0 microversion: 2.1 time: 0.121445 Jul 07 07:24:52.310205 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 282/573] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:24:52 2022] DELETE /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:24:52.319015 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4b48f4fd-7831-47dd-9733-607b5f0a0a73 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:52.319854 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4b48f4fd-7831-47dd-9733-607b5f0a0a73 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:52.326816 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b48f4fd-7831-47dd-9733-607b5f0a0a73 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.327271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b48f4fd-7831-47dd-9733-607b5f0a0a73 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.328317 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b48f4fd-7831-47dd-9733-607b5f0a0a73 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.328763 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4b48f4fd-7831-47dd-9733-607b5f0a0a73 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.471474 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4b48f4fd-7831-47dd-9733-607b5f0a0a73 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:52.483165 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4b48f4fd-7831-47dd-9733-607b5f0a0a73 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1672 microversion: 2.1 time: 0.168286 Jul 07 07:24:52.484087 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 292/574] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:52 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:52.692589 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-66b088d7-0711-4f1d-bc90-6ef4407b3e7e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:52.693212 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-66b088d7-0711-4f1d-bc90-6ef4407b3e7e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:52.700023 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66b088d7-0711-4f1d-bc90-6ef4407b3e7e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.700472 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66b088d7-0711-4f1d-bc90-6ef4407b3e7e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.701255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66b088d7-0711-4f1d-bc90-6ef4407b3e7e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.701696 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-66b088d7-0711-4f1d-bc90-6ef4407b3e7e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.840962 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-66b088d7-0711-4f1d-bc90-6ef4407b3e7e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:52.849048 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-66b088d7-0711-4f1d-bc90-6ef4407b3e7e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1730 microversion: 2.1 time: 0.160889 Jul 07 07:24:52.849652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 283/575] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:52 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:52.865358 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d9f77205-72bf-402b-8e7e-b640679cc633 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:52.865878 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d9f77205-72bf-402b-8e7e-b640679cc633 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:52.872290 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d9f77205-72bf-402b-8e7e-b640679cc633 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.872743 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d9f77205-72bf-402b-8e7e-b640679cc633 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.873535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d9f77205-72bf-402b-8e7e-b640679cc633 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.873965 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d9f77205-72bf-402b-8e7e-b640679cc633 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.956358 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d9f77205-72bf-402b-8e7e-b640679cc633 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094656 Jul 07 07:24:52.957173 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 293/576] 10.222.0.62 () {58 vars in 1274 bytes} [Thu Jul 7 07:24:52 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:52.978854 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6d382a5c-78da-438b-b307-0e7990556cdc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:52.979760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6d382a5c-78da-438b-b307-0e7990556cdc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:52.986513 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d382a5c-78da-438b-b307-0e7990556cdc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.986956 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d382a5c-78da-438b-b307-0e7990556cdc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:52.987742 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d382a5c-78da-438b-b307-0e7990556cdc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:52.988121 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6d382a5c-78da-438b-b307-0e7990556cdc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:53.024449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6d382a5c-78da-438b-b307-0e7990556cdc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049600 Jul 07 07:24:53.025246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 284/577] 10.222.0.62 () {60 vars in 1342 bytes} [Thu Jul 7 07:24:52 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:24:53.501728 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-45d67b7a-6629-4371-b595-26d92d0546cf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:53.502342 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-45d67b7a-6629-4371-b595-26d92d0546cf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:53.508993 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45d67b7a-6629-4371-b595-26d92d0546cf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:53.509470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45d67b7a-6629-4371-b595-26d92d0546cf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:53.510257 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45d67b7a-6629-4371-b595-26d92d0546cf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:53.510719 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-45d67b7a-6629-4371-b595-26d92d0546cf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:53.990816 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-45d67b7a-6629-4371-b595-26d92d0546cf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:53.998626 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-45d67b7a-6629-4371-b595-26d92d0546cf tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1672 microversion: 2.1 time: 0.500757 Jul 07 07:24:53.999205 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 294/578] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:53 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1672 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:54.038435 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7017b2cb-389e-4205-a42d-0b5a2cbd96bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:54.039731 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7017b2cb-389e-4205-a42d-0b5a2cbd96bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:54.046654 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7017b2cb-389e-4205-a42d-0b5a2cbd96bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:54.047090 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7017b2cb-389e-4205-a42d-0b5a2cbd96bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:54.047913 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7017b2cb-389e-4205-a42d-0b5a2cbd96bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:54.048352 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7017b2cb-389e-4205-a42d-0b5a2cbd96bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:54.079825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7017b2cb-389e-4205-a42d-0b5a2cbd96bc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047443 Jul 07 07:24:54.080567 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 285/579] 10.222.0.62 () {60 vars in 1342 bytes} [Thu Jul 7 07:24:54 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:24:54.220101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-611f4a8f-e6ed-443e-ad65-6798a307d70d req-273d3ed2-92b4-4a28-a2a8-0f0f2254acfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c68b9418-cc4f-41da-8dba-1ef31555120e", "tag": "2522ba46-c373-47c1-914e-51023019a66c"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:54.228972 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-611f4a8f-e6ed-443e-ad65-6798a307d70d req-273d3ed2-92b4-4a28-a2a8-0f0f2254acfb service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:54.229488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-611f4a8f-e6ed-443e-ad65-6798a307d70d req-273d3ed2-92b4-4a28-a2a8-0f0f2254acfb service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:54.241791 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-611f4a8f-e6ed-443e-ad65-6798a307d70d req-273d3ed2-92b4-4a28-a2a8-0f0f2254acfb service nova] Creating event network-changed:2522ba46-c373-47c1-914e-51023019a66c for instance c68b9418-cc4f-41da-8dba-1ef31555120e on hv-cinder-82660 Jul 07 07:24:54.246906 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-611f4a8f-e6ed-443e-ad65-6798a307d70d req-273d3ed2-92b4-4a28-a2a8-0f0f2254acfb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030979 Jul 07 07:24:54.247821 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 295/580] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:55.016658 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-def8ec65-493c-4a53-86cd-fc538ea0ed95 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:55.017298 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-def8ec65-493c-4a53-86cd-fc538ea0ed95 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:55.023655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-def8ec65-493c-4a53-86cd-fc538ea0ed95 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:55.024102 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-def8ec65-493c-4a53-86cd-fc538ea0ed95 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:55.024864 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-def8ec65-493c-4a53-86cd-fc538ea0ed95 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:55.025339 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-def8ec65-493c-4a53-86cd-fc538ea0ed95 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:55.092966 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c076d409-0ede-4766-ac19-19d86a3374a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:55.094704 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c076d409-0ede-4766-ac19-19d86a3374a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:55.102363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c076d409-0ede-4766-ac19-19d86a3374a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:55.102882 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c076d409-0ede-4766-ac19-19d86a3374a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:55.103786 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c076d409-0ede-4766-ac19-19d86a3374a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:55.104493 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c076d409-0ede-4766-ac19-19d86a3374a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:55.136590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c076d409-0ede-4766-ac19-19d86a3374a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048306 Jul 07 07:24:55.137511 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 296/581] 10.222.0.62 () {60 vars in 1342 bytes} [Thu Jul 7 07:24:55 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:24:55.173106 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-def8ec65-493c-4a53-86cd-fc538ea0ed95 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:55.181496 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-def8ec65-493c-4a53-86cd-fc538ea0ed95 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1672 microversion: 2.1 time: 0.169188 Jul 07 07:24:55.182076 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 286/582] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:55 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:55.762614 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9f60103a-3536-4dd7-bda2-bfa110576e33 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:55.763573 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9f60103a-3536-4dd7-bda2-bfa110576e33 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:55.770514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f60103a-3536-4dd7-bda2-bfa110576e33 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:55.770968 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f60103a-3536-4dd7-bda2-bfa110576e33 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:55.771751 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f60103a-3536-4dd7-bda2-bfa110576e33 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:55.772186 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f60103a-3536-4dd7-bda2-bfa110576e33 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:55.849799 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9f60103a-3536-4dd7-bda2-bfa110576e33 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "POST /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/action" status: 202 len: 0 microversion: 2.1 time: 0.091100 Jul 07 07:24:55.850714 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 297/583] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:24:55 2022] POST /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:24:55.859231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-84b2fc23-fe3a-4fd7-9493-9e64c193bd90 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:55.860000 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-84b2fc23-fe3a-4fd7-9493-9e64c193bd90 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:55.867146 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84b2fc23-fe3a-4fd7-9493-9e64c193bd90 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:55.867778 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84b2fc23-fe3a-4fd7-9493-9e64c193bd90 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:55.868602 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84b2fc23-fe3a-4fd7-9493-9e64c193bd90 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:55.869040 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-84b2fc23-fe3a-4fd7-9493-9e64c193bd90 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:56.029666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-84b2fc23-fe3a-4fd7-9493-9e64c193bd90 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:56.038822 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-84b2fc23-fe3a-4fd7-9493-9e64c193bd90 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1750 microversion: 2.1 time: 0.183541 Jul 07 07:24:56.039610 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 287/584] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:55 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:56.150034 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e4782137-7671-4b46-b932-8abd4202eea4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:56.151072 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e4782137-7671-4b46-b932-8abd4202eea4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:56.158370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4782137-7671-4b46-b932-8abd4202eea4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:56.158855 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4782137-7671-4b46-b932-8abd4202eea4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:56.159653 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4782137-7671-4b46-b932-8abd4202eea4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:56.160085 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e4782137-7671-4b46-b932-8abd4202eea4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:56.193904 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e4782137-7671-4b46-b932-8abd4202eea4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048660 Jul 07 07:24:56.194898 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 298/585] 10.222.0.62 () {60 vars in 1342 bytes} [Thu Jul 7 07:24:56 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:56.199969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-464de6af-b452-4664-ac6e-57cf8d7224d6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:56.200570 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-464de6af-b452-4664-ac6e-57cf8d7224d6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:56.209280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-464de6af-b452-4664-ac6e-57cf8d7224d6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:56.209748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-464de6af-b452-4664-ac6e-57cf8d7224d6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:56.210638 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-464de6af-b452-4664-ac6e-57cf8d7224d6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:56.211164 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-464de6af-b452-4664-ac6e-57cf8d7224d6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:56.259031 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4be1afba-0f7e-493f-a2ee-b8cd5783eb12 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:56.259903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4be1afba-0f7e-493f-a2ee-b8cd5783eb12 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:56.266929 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4be1afba-0f7e-493f-a2ee-b8cd5783eb12 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:56.267663 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4be1afba-0f7e-493f-a2ee-b8cd5783eb12 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:56.268723 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4be1afba-0f7e-493f-a2ee-b8cd5783eb12 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:56.269357 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4be1afba-0f7e-493f-a2ee-b8cd5783eb12 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:56.300229 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4be1afba-0f7e-493f-a2ee-b8cd5783eb12 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:24:56.332015 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:56.378453 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-464de6af-b452-4664-ac6e-57cf8d7224d6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:56.391484 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-464de6af-b452-4664-ac6e-57cf8d7224d6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1672 microversion: 2.1 time: 0.195123 Jul 07 07:24:56.402206 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 288/586] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:56 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1672 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:56.408684 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-d407e588-86e4-471b-986f-3af9a45b9615 req-fbe22dbb-5654-4162-9aa5-b36f93cdc1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c68b9418-cc4f-41da-8dba-1ef31555120e", "tag": "2522ba46-c373-47c1-914e-51023019a66c"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:56.411426 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4be1afba-0f7e-493f-a2ee-b8cd5783eb12 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 204 len: 0 microversion: 2.20 time: 0.156011 Jul 07 07:24:56.412022 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 299/587] 10.222.0.62 () {60 vars in 1279 bytes} [Thu Jul 7 07:24:56 2022] DELETE /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 07:24:56.418036 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-d407e588-86e4-471b-986f-3af9a45b9615 req-fbe22dbb-5654-4162-9aa5-b36f93cdc1d8 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:56.418610 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-d407e588-86e4-471b-986f-3af9a45b9615 req-fbe22dbb-5654-4162-9aa5-b36f93cdc1d8 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:56.421373 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7d44375b-7069-4da8-b475-7fa4fbe443ac tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:56.422111 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7d44375b-7069-4da8-b475-7fa4fbe443ac tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:56.430251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d44375b-7069-4da8-b475-7fa4fbe443ac tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:56.430706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d44375b-7069-4da8-b475-7fa4fbe443ac tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:56.431891 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d44375b-7069-4da8-b475-7fa4fbe443ac tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:56.432378 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7d44375b-7069-4da8-b475-7fa4fbe443ac tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:56.433048 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-d407e588-86e4-471b-986f-3af9a45b9615 req-fbe22dbb-5654-4162-9aa5-b36f93cdc1d8 service nova] Creating event network-changed:2522ba46-c373-47c1-914e-51023019a66c for instance c68b9418-cc4f-41da-8dba-1ef31555120e on hv-cinder-82660 Jul 07 07:24:56.438546 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-d407e588-86e4-471b-986f-3af9a45b9615 req-fbe22dbb-5654-4162-9aa5-b36f93cdc1d8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033891 Jul 07 07:24:56.439393 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 289/588] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:56.574781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7d44375b-7069-4da8-b475-7fa4fbe443ac tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:56.583529 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7d44375b-7069-4da8-b475-7fa4fbe443ac tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:56.585027 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7d44375b-7069-4da8-b475-7fa4fbe443ac tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:56.586216 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7d44375b-7069-4da8-b475-7fa4fbe443ac tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.169354 Jul 07 07:24:56.586774 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 300/589] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:24:56 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:24:57.056742 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ca53d7e2-9a88-4cd1-8c6a-2bec4cf6c5f1 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:57.057453 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ca53d7e2-9a88-4cd1-8c6a-2bec4cf6c5f1 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:57.064649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca53d7e2-9a88-4cd1-8c6a-2bec4cf6c5f1 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:57.065469 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca53d7e2-9a88-4cd1-8c6a-2bec4cf6c5f1 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:57.066257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca53d7e2-9a88-4cd1-8c6a-2bec4cf6c5f1 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:57.066869 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca53d7e2-9a88-4cd1-8c6a-2bec4cf6c5f1 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:57.093565 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-7d6ba644-a246-4f62-b392-7dc407bfaf2c req-c9086ec8-1cc1-4f72-bdb5-43e171a492a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec188266-15a7-4559-ab29-6025dd7837e5", "name": "network-vif-deleted", "tag": "11de54d7-a166-4f12-8b83-93407305355c"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:24:57.103654 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-7d6ba644-a246-4f62-b392-7dc407bfaf2c req-c9086ec8-1cc1-4f72-bdb5-43e171a492a3 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:57.104211 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-7d6ba644-a246-4f62-b392-7dc407bfaf2c req-c9086ec8-1cc1-4f72-bdb5-43e171a492a3 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:57.116468 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-7d6ba644-a246-4f62-b392-7dc407bfaf2c req-c9086ec8-1cc1-4f72-bdb5-43e171a492a3 service nova] Creating event network-vif-deleted:11de54d7-a166-4f12-8b83-93407305355c for instance ec188266-15a7-4559-ab29-6025dd7837e5 on hv-cinder-82660 Jul 07 07:24:57.121818 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-7d6ba644-a246-4f62-b392-7dc407bfaf2c req-c9086ec8-1cc1-4f72-bdb5-43e171a492a3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032622 Jul 07 07:24:57.122708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 301/590] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:24:57.227969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ca53d7e2-9a88-4cd1-8c6a-2bec4cf6c5f1 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:57.237260 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ca53d7e2-9a88-4cd1-8c6a-2bec4cf6c5f1 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1750 microversion: 2.1 time: 0.184567 Jul 07 07:24:57.239229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 290/591] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:57 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:57.412859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-46309236-1b9c-41fc-af0f-313d956b9dbe tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:57.413681 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-46309236-1b9c-41fc-af0f-313d956b9dbe tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:57.420438 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46309236-1b9c-41fc-af0f-313d956b9dbe tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:57.420856 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46309236-1b9c-41fc-af0f-313d956b9dbe tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:57.421819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46309236-1b9c-41fc-af0f-313d956b9dbe tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:57.422264 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-46309236-1b9c-41fc-af0f-313d956b9dbe tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:57.487204 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-46309236-1b9c-41fc-af0f-313d956b9dbe tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:57.494874 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-46309236-1b9c-41fc-af0f-313d956b9dbe tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1605 microversion: 2.1 time: 0.086895 Jul 07 07:24:57.495441 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 302/592] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:57 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1605 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:57.604131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-69a6c877-1980-4274-8855-030559f1eaa4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:57.604740 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-69a6c877-1980-4274-8855-030559f1eaa4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:57.611082 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69a6c877-1980-4274-8855-030559f1eaa4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:57.611531 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69a6c877-1980-4274-8855-030559f1eaa4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:57.612371 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69a6c877-1980-4274-8855-030559f1eaa4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:57.612804 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-69a6c877-1980-4274-8855-030559f1eaa4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:57.750396 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-69a6c877-1980-4274-8855-030559f1eaa4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:57.758627 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-69a6c877-1980-4274-8855-030559f1eaa4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:57.760238 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-69a6c877-1980-4274-8855-030559f1eaa4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:57.761480 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-69a6c877-1980-4274-8855-030559f1eaa4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.161247 Jul 07 07:24:57.762053 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 291/593] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:24:57 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:24:58.254528 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2d4ca1f4-2cb4-49eb-888e-755f4d2b1cef tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:58.255043 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2d4ca1f4-2cb4-49eb-888e-755f4d2b1cef tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:58.261457 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d4ca1f4-2cb4-49eb-888e-755f4d2b1cef tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:58.261893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d4ca1f4-2cb4-49eb-888e-755f4d2b1cef tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:58.262925 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d4ca1f4-2cb4-49eb-888e-755f4d2b1cef tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:58.263545 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d4ca1f4-2cb4-49eb-888e-755f4d2b1cef tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:58.417963 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2d4ca1f4-2cb4-49eb-888e-755f4d2b1cef tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:58.426452 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2d4ca1f4-2cb4-49eb-888e-755f4d2b1cef tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1750 microversion: 2.1 time: 0.176009 Jul 07 07:24:58.427032 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 303/594] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:58 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:58.515527 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:58.516440 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:58.524105 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:58.524555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:58.525390 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:58.525804 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:58.554661 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:58.559064 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:58.559830 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:58.560263 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lazy-loading 'fault' on Instance uuid ec188266-15a7-4559-ab29-6025dd7837e5 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:24:58.616454 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:58.624399 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d2b9069a-bad6-440d-b145-9a3b71470456 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 200 len: 1326 microversion: 2.1 time: 0.115155 Jul 07 07:24:58.624972 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 292/595] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:58 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:58.780247 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-79265427-3150-4f53-96ae-d33c31702d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:58.780759 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-79265427-3150-4f53-96ae-d33c31702d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:58.792013 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79265427-3150-4f53-96ae-d33c31702d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:58.792366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79265427-3150-4f53-96ae-d33c31702d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:58.793437 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79265427-3150-4f53-96ae-d33c31702d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:58.793806 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-79265427-3150-4f53-96ae-d33c31702d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:58.934400 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-79265427-3150-4f53-96ae-d33c31702d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:58.943331 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-79265427-3150-4f53-96ae-d33c31702d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:58.944909 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-79265427-3150-4f53-96ae-d33c31702d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:58.946208 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-79265427-3150-4f53-96ae-d33c31702d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1721 microversion: 2.20 time: 0.170107 Jul 07 07:24:58.946848 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 304/596] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:24:58 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:24:59.446688 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-113c7a19-a6ce-43a2-a395-4db9c8a0549c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:59.447757 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-113c7a19-a6ce-43a2-a395-4db9c8a0549c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:59.455945 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-113c7a19-a6ce-43a2-a395-4db9c8a0549c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:59.456531 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-113c7a19-a6ce-43a2-a395-4db9c8a0549c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:59.457466 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-113c7a19-a6ce-43a2-a395-4db9c8a0549c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:59.457987 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-113c7a19-a6ce-43a2-a395-4db9c8a0549c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:59.618031 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-113c7a19-a6ce-43a2-a395-4db9c8a0549c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:24:59.621816 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:59.627750 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-113c7a19-a6ce-43a2-a395-4db9c8a0549c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1755 microversion: 2.1 time: 0.186720 Jul 07 07:24:59.628419 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 293/597] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:59 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:24:59.642591 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c113393c-d836-4877-84fd-4f1963d436df tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:59.643875 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c113393c-d836-4877-84fd-4f1963d436df tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:59.650498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c113393c-d836-4877-84fd-4f1963d436df tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:59.650950 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c113393c-d836-4877-84fd-4f1963d436df tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:59.651727 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c113393c-d836-4877-84fd-4f1963d436df tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:59.652157 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c113393c-d836-4877-84fd-4f1963d436df tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:59.669125 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-c113393c-d836-4877-84fd-4f1963d436df tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] HTTP exception thrown: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c113393c-d836-4877-84fd-4f1963d436df tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Request method failure captured: Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 HTTP/1.1 Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixokwC6C6f5sc-IWaiilecIlWZW-JLtNFu0gVWJEv1gOFObdfRmiK0o672cLL3vOtXZNAm1m9xX6qdCcT7R6SvT5_8ycXo3s0DjB_O-PWCXD-Vg4BiISEZFGuZerMHfNgs25V7fABgtONSHYmI0ux_tLXuwRIrhRQHqQ8gxQRw6sWWa0 Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:24:59.670936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_35c14f84eaf04060acc489e77027c824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/35c14f84eaf04060acc489e77027c824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 16293fa03ced44cc994a0b8ad19ebb89 Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:24:59.672696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': 'ec188266-15a7-4559-ab29-6025dd7837e5'} Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:24:59.674025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:24:59.675444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:24:59.676903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c113393c-d836-4877-84fd-4f1963d436df tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Returning 404 to user: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:24:59.676903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c113393c-d836-4877-84fd-4f1963d436df tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 404 len: 111 microversion: 2.1 time: 0.033923 Jul 07 07:24:59.676903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 305/598] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:24:59 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:24:59.682752 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b1c29b90-dfd4-4729-b530-8862dfe2e041 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '.version_select at 0x7fccfa50d700>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:59.708332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b1c29b90-dfd4-4729-b530-8862dfe2e041 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887985396" status: 202 len: 0 microversion: 2.1 time: 0.029225 Jul 07 07:24:59.708625 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 294/599] 10.222.0.62 () {58 vars in 1217 bytes} [Thu Jul 7 07:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887985396 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:24:59.966059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-65e2aa19-4574-43fa-a8f2-68cb5300477b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:24:59.966581 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-65e2aa19-4574-43fa-a8f2-68cb5300477b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:24:59.968696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:24:59.977938 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-65e2aa19-4574-43fa-a8f2-68cb5300477b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:59.978476 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-65e2aa19-4574-43fa-a8f2-68cb5300477b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:24:59.979564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-65e2aa19-4574-43fa-a8f2-68cb5300477b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:24:59.980093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-65e2aa19-4574-43fa-a8f2-68cb5300477b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:00.072312 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-65e2aa19-4574-43fa-a8f2-68cb5300477b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:00.083511 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-65e2aa19-4574-43fa-a8f2-68cb5300477b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:00.085028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-65e2aa19-4574-43fa-a8f2-68cb5300477b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:00.086231 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-65e2aa19-4574-43fa-a8f2-68cb5300477b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 200 len: 1654 microversion: 2.20 time: 0.126040 Jul 07 07:25:00.086798 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 306/600] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:24:59 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 1654 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:25:00.133923 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-799daf3f-1a22-43fc-8fdd-209f1799ee12 req-9ce06ff4-b20f-4ce2-8cb0-b00860e0ba66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c", "name": "network-vif-deleted", "tag": "7d78694f-a735-488f-84c8-ca44f4d7aba7"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:00.155079 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-799daf3f-1a22-43fc-8fdd-209f1799ee12 req-9ce06ff4-b20f-4ce2-8cb0-b00860e0ba66 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:00.155887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-799daf3f-1a22-43fc-8fdd-209f1799ee12 req-9ce06ff4-b20f-4ce2-8cb0-b00860e0ba66 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:00.177600 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-799daf3f-1a22-43fc-8fdd-209f1799ee12 req-9ce06ff4-b20f-4ce2-8cb0-b00860e0ba66 service nova] Creating event network-vif-deleted:7d78694f-a735-488f-84c8-ca44f4d7aba7 for instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c on hv-cinder-82660 Jul 07 07:25:00.184803 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-799daf3f-1a22-43fc-8fdd-209f1799ee12 req-9ce06ff4-b20f-4ce2-8cb0-b00860e0ba66 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056078 Jul 07 07:25:00.189420 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 295/601] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:00.485403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-da256f5f-2e18-49f4-b9b0-fdfc05ef6020 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'create', calling method: .version_select at 0x7fccfa111dc0>, body: {"keypair": {"name": "tempest-keypair-150488889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1cpyp5FE8C9MoURAD1GfwdkxgSbWMFsVBuj3pX6ALC01OZsTWsy6toL87IjdFI9WDdMrSmWR3z8H6GHWrT0zUV6JFQDfCc/rv0IM11lPV9nja9TN0ZACtqUc8QweYC+w=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:00.502056 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-da256f5f-2e18-49f4-b9b0-fdfc05ef6020 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Getting quotas for project 35c14f84eaf04060acc489e77027c824. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:25:00.506782 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-da256f5f-2e18-49f4-b9b0-fdfc05ef6020 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Getting quotas for user 16293fa03ced44cc994a0b8ad19ebb89 and project 35c14f84eaf04060acc489e77027c824. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:25:00.529967 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-da256f5f-2e18-49f4-b9b0-fdfc05ef6020 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048559 Jul 07 07:25:00.530593 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 307/602] 10.222.0.62 () {60 vars in 1158 bytes} [Thu Jul 7 07:25:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:25:00.649073 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7a35a886-6b57-4d1f-91d4-4b2700eaeb02 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:00.650662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7a35a886-6b57-4d1f-91d4-4b2700eaeb02 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:00.657768 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a35a886-6b57-4d1f-91d4-4b2700eaeb02 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:00.658470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a35a886-6b57-4d1f-91d4-4b2700eaeb02 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:00.660412 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a35a886-6b57-4d1f-91d4-4b2700eaeb02 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:00.661014 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a35a886-6b57-4d1f-91d4-4b2700eaeb02 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:00.877093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7a35a886-6b57-4d1f-91d4-4b2700eaeb02 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:00.886482 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7a35a886-6b57-4d1f-91d4-4b2700eaeb02 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1755 microversion: 2.1 time: 0.243476 Jul 07 07:25:00.887211 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 296/603] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:00 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1755 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:01.106363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b755ab48-09d1-4355-bb96-f4430e153b7b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:01.107289 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b755ab48-09d1-4355-bb96-f4430e153b7b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:01.114762 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b755ab48-09d1-4355-bb96-f4430e153b7b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:01.115353 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b755ab48-09d1-4355-bb96-f4430e153b7b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:01.116251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b755ab48-09d1-4355-bb96-f4430e153b7b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:01.117426 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b755ab48-09d1-4355-bb96-f4430e153b7b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:01.133728 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-b755ab48-09d1-4355-bb96-f4430e153b7b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] HTTP exception thrown: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b755ab48-09d1-4355-bb96-f4430e153b7b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Request method failure captured: Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c HTTP/1.1 Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixok2aoNzCeuUXC_Pw4YcoECVvmWHDMVuY8kjsOk3CwDYpNIk6nRnjSQM4u2c-8R9ljZsLWDRlbyvgGj3W7jwveCkTMn53ZUEHuuPyTEuussFIxzv5_2LNDkUPHsGydRCwjsAImfUm4UqdNhL9IgV6v732kZJuDUjv7askuuVqPrDFaA Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:25:01.134589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7e48122318d446438ef9974475c3f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: d6db138644b14a20a43b3b1b3fa63314 Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:25:01.136209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c'} Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:25:01.137137 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:25:01.138527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:25:01.139813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b755ab48-09d1-4355-bb96-f4430e153b7b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Returning 404 to user: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:25:01.139813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b755ab48-09d1-4355-bb96-f4430e153b7b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 404 len: 111 microversion: 2.20 time: 0.037018 Jul 07 07:25:01.140172 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 308/604] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:01 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 07 07:25:01.149174 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c4f4b1a2-5bcd-4e2c-ad03-2f830d77d403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '.version_select at 0x7fccfa50d820>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:01.170377 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c4f4b1a2-5bcd-4e2c-ad03-2f830d77d403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781084651" status: 204 len: 0 microversion: 2.20 time: 0.025215 Jul 07 07:25:01.171716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 297/605] 10.222.0.62 () {60 vars in 1261 bytes} [Thu Jul 7 07:25:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1781084651 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 07 07:25:01.904272 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ba25c548-e4c7-4298-81bf-b176408a0717 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:01.905138 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ba25c548-e4c7-4298-81bf-b176408a0717 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:01.912263 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba25c548-e4c7-4298-81bf-b176408a0717 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:01.912718 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba25c548-e4c7-4298-81bf-b176408a0717 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:01.913530 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba25c548-e4c7-4298-81bf-b176408a0717 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:01.914007 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba25c548-e4c7-4298-81bf-b176408a0717 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:02.019897 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1670507397", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eeaefd19-27c3-4667-8957-3736024eb39e"}], "security_groups": [{"name": "tempest-securitygroup--1747086937"}], "key_name": "tempest-keypair-150488889", "user_data": "}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:02.116790 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ba25c548-e4c7-4298-81bf-b176408a0717 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:02.125344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ba25c548-e4c7-4298-81bf-b176408a0717 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1755 microversion: 2.1 time: 0.225036 Jul 07 07:25:02.126070 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 309/606] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:01 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1755 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:02.130964 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6787f484-958b-4c4f-ac93-826c9f02ec58 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Action: 'create', calling method: .version_select at 0x7fccf9f12940>, body: {"keypair": {"name": "tempest-keypair-1678075745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVLVBKYShQ5cVn7h3qtmQ+q1oSeZbgvcLeX1FzfKY7KMNUAthThNUpPIC6vDf4JOYlH8gWGOg3ug/XlJdqvA513c0D0aWiVYAWbpCPPvUHXvD3m3DLOVyAbJR8zrqXigw=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:02.144983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-6787f484-958b-4c4f-ac93-826c9f02ec58 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Getting quotas for project 7e48122318d446438ef9974475c3f6ca. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:25:02.145714 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] validate_networks() for [('eeaefd19-27c3-4667-8957-3736024eb39e', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:25:02.148807 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-6787f484-958b-4c4f-ac93-826c9f02ec58 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Getting quotas for user d6db138644b14a20a43b3b1b3fa63314 and project 7e48122318d446438ef9974475c3f6ca. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:25:02.171289 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6787f484-958b-4c4f-ac93-826c9f02ec58 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043925 Jul 07 07:25:02.171922 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 310/607] 10.222.0.62 () {62 vars in 1199 bytes} [Thu Jul 7 07:25:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 07 07:25:02.539215 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:25:02.539640 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:25:02.540146 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:25:02.540585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:25:02.540985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:25:02.550773 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:02.551360 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:02.552307 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:02.552791 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:02.570799 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Getting quotas for project 35c14f84eaf04060acc489e77027c824. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:25:02.575494 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Getting quotas for user 16293fa03ced44cc994a0b8ad19ebb89 and project 35c14f84eaf04060acc489e77027c824. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:25:02.592334 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:25:02.594745 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:25:02.645073 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c42150cb-2d12-4758-bf25-2623ad103eb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.629382 Jul 07 07:25:02.650820 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 298/608] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:25:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:25:02.660074 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c6d82a78-345a-4c9a-a12b-471e0ea1b8b9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:02.661051 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c6d82a78-345a-4c9a-a12b-471e0ea1b8b9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:02.739189 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c6d82a78-345a-4c9a-a12b-471e0ea1b8b9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:02.746032 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c6d82a78-345a-4c9a-a12b-471e0ea1b8b9 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1237 microversion: 2.1 time: 0.093554 Jul 07 07:25:02.746641 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 311/609] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:02 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1237 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:03.143934 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6369b0e2-c289-4945-aa54-f736f33707a2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:03.144658 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6369b0e2-c289-4945-aa54-f736f33707a2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:03.152730 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6369b0e2-c289-4945-aa54-f736f33707a2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:03.153298 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6369b0e2-c289-4945-aa54-f736f33707a2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:03.154180 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6369b0e2-c289-4945-aa54-f736f33707a2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:03.154676 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6369b0e2-c289-4945-aa54-f736f33707a2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:03.398335 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6369b0e2-c289-4945-aa54-f736f33707a2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:03.408236 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6369b0e2-c289-4945-aa54-f736f33707a2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1755 microversion: 2.1 time: 0.269212 Jul 07 07:25:03.408878 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 299/610] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:03 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1755 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:03.635842 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1481701504", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d6bb8087-3a4e-4f38-8bd3-6dfc3a61f1eb"}], "security_groups": [{"name": "tempest-securitygroup--682033246"}], "key_name": "tempest-keypair-1678075745", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:03.746028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] validate_networks() for [('d6bb8087-3a4e-4f38-8bd3-6dfc3a61f1eb', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:25:03.764170 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-029acedc-9cde-4f31-bfcb-d8a936d9ae8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:03.764833 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-029acedc-9cde-4f31-bfcb-d8a936d9ae8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:03.773147 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-029acedc-9cde-4f31-bfcb-d8a936d9ae8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:03.773916 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-029acedc-9cde-4f31-bfcb-d8a936d9ae8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:03.774974 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-029acedc-9cde-4f31-bfcb-d8a936d9ae8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:03.775407 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-029acedc-9cde-4f31-bfcb-d8a936d9ae8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:03.870557 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-029acedc-9cde-4f31-bfcb-d8a936d9ae8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:03.879014 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-029acedc-9cde-4f31-bfcb-d8a936d9ae8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1307 microversion: 2.1 time: 0.119939 Jul 07 07:25:03.888498 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 300/611] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:03 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1307 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:04.420264 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:25:04.420913 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:25:04.421666 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:25:04.422166 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:25:04.422668 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:25:04.426780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8c328ef7-86e3-47c9-831c-a187aaeeeca2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:04.427651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8c328ef7-86e3-47c9-831c-a187aaeeeca2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:04.432921 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:04.433651 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:04.434746 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8c328ef7-86e3-47c9-831c-a187aaeeeca2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:04.434917 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:04.435484 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:04.435597 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8c328ef7-86e3-47c9-831c-a187aaeeeca2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:04.436344 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8c328ef7-86e3-47c9-831c-a187aaeeeca2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:04.436783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8c328ef7-86e3-47c9-831c-a187aaeeeca2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:04.453347 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Getting quotas for project 7e48122318d446438ef9974475c3f6ca. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:25:04.458688 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Getting quotas for user d6db138644b14a20a43b3b1b3fa63314 and project 7e48122318d446438ef9974475c3f6ca. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:25:04.470635 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:25:04.473721 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:25:04.538576 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-594f90f8-5770-4ca6-bb13-fb1f0b2de5e7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.907892 Jul 07 07:25:04.544742 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 312/612] 10.222.0.62 () {62 vars in 1187 bytes} [Thu Jul 7 07:25:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 07 07:25:04.552425 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-71d59b8a-54e2-49e1-b67e-c082093ba55e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:04.553280 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-71d59b8a-54e2-49e1-b67e-c082093ba55e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:04.657495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-71d59b8a-54e2-49e1-b67e-c082093ba55e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:04.665907 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-71d59b8a-54e2-49e1-b67e-c082093ba55e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:04.667290 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8c328ef7-86e3-47c9-831c-a187aaeeeca2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:04.667451 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-71d59b8a-54e2-49e1-b67e-c082093ba55e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:04.668591 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-71d59b8a-54e2-49e1-b67e-c082093ba55e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1282 microversion: 2.20 time: 0.122262 Jul 07 07:25:04.669506 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 313/613] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:04 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1282 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:04.678552 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8c328ef7-86e3-47c9-831c-a187aaeeeca2 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1755 microversion: 2.1 time: 0.255438 Jul 07 07:25:04.679239 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 301/614] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:04 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1755 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:25:04.895891 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4fd65607-5b19-44b8-acd3-05b6da530774 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:04.896779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4fd65607-5b19-44b8-acd3-05b6da530774 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:04.903152 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4fd65607-5b19-44b8-acd3-05b6da530774 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:04.903566 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4fd65607-5b19-44b8-acd3-05b6da530774 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:04.904621 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4fd65607-5b19-44b8-acd3-05b6da530774 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:04.905254 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4fd65607-5b19-44b8-acd3-05b6da530774 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:05.073654 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4fd65607-5b19-44b8-acd3-05b6da530774 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:05.081971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4fd65607-5b19-44b8-acd3-05b6da530774 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1363 microversion: 2.1 time: 0.189871 Jul 07 07:25:05.082617 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 314/615] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:04 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:05.410858 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-83667975-b2e2-41e6-9691-14ee91b178fc req-5fe6b206-ade4-45c2-bc8a-f71f838f06b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14904778-9fa1-42ab-9f55-44a650b96877", "tag": "8e8e0c70-6136-45d2-8c16-1484b1913b94"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:05.420902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-83667975-b2e2-41e6-9691-14ee91b178fc req-5fe6b206-ade4-45c2-bc8a-f71f838f06b4 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:05.421369 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-83667975-b2e2-41e6-9691-14ee91b178fc req-5fe6b206-ade4-45c2-bc8a-f71f838f06b4 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:05.435596 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-83667975-b2e2-41e6-9691-14ee91b178fc req-5fe6b206-ade4-45c2-bc8a-f71f838f06b4 service nova] Creating event network-changed:8e8e0c70-6136-45d2-8c16-1484b1913b94 for instance 14904778-9fa1-42ab-9f55-44a650b96877 on hv-cinder-82660 Jul 07 07:25:05.441173 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-83667975-b2e2-41e6-9691-14ee91b178fc req-5fe6b206-ade4-45c2-bc8a-f71f838f06b4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034260 Jul 07 07:25:05.441893 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 302/616] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:05.687518 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dc9a633d-b019-4076-93a7-d8ecdd9b2fd4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:05.688844 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dc9a633d-b019-4076-93a7-d8ecdd9b2fd4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:05.696563 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0c8e979c-117b-453f-a95c-6d1c8aa86cc5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:05.697919 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0c8e979c-117b-453f-a95c-6d1c8aa86cc5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:05.701261 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc9a633d-b019-4076-93a7-d8ecdd9b2fd4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:05.701261 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc9a633d-b019-4076-93a7-d8ecdd9b2fd4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:05.702655 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc9a633d-b019-4076-93a7-d8ecdd9b2fd4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:05.703279 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dc9a633d-b019-4076-93a7-d8ecdd9b2fd4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:05.717118 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8e979c-117b-453f-a95c-6d1c8aa86cc5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:05.717605 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8e979c-117b-453f-a95c-6d1c8aa86cc5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:05.718402 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8e979c-117b-453f-a95c-6d1c8aa86cc5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:05.718837 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8e979c-117b-453f-a95c-6d1c8aa86cc5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:05.777028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dc9a633d-b019-4076-93a7-d8ecdd9b2fd4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:05.785164 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dc9a633d-b019-4076-93a7-d8ecdd9b2fd4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:05.786681 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dc9a633d-b019-4076-93a7-d8ecdd9b2fd4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:05.787861 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dc9a633d-b019-4076-93a7-d8ecdd9b2fd4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1334 microversion: 2.20 time: 0.104609 Jul 07 07:25:05.788413 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 315/617] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:05 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1334 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:06.002281 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0c8e979c-117b-453f-a95c-6d1c8aa86cc5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:06.011809 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0c8e979c-117b-453f-a95c-6d1c8aa86cc5 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1755 microversion: 2.1 time: 0.319406 Jul 07 07:25:06.012857 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 303/618] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:05 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1755 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:25:06.098549 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b73ef489-ed1f-48e0-987f-0c9180e5de79 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:06.099157 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b73ef489-ed1f-48e0-987f-0c9180e5de79 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:06.109113 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b73ef489-ed1f-48e0-987f-0c9180e5de79 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:06.110603 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b73ef489-ed1f-48e0-987f-0c9180e5de79 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:06.112181 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b73ef489-ed1f-48e0-987f-0c9180e5de79 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:06.112718 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b73ef489-ed1f-48e0-987f-0c9180e5de79 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:06.251952 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b73ef489-ed1f-48e0-987f-0c9180e5de79 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:06.259937 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b73ef489-ed1f-48e0-987f-0c9180e5de79 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1363 microversion: 2.1 time: 0.165247 Jul 07 07:25:06.260511 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 316/619] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:06 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:06.805988 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e4f58d8-2697-4c4f-ac87-47c89087eccb tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:06.806604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3e4f58d8-2697-4c4f-ac87-47c89087eccb tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:06.814401 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e4f58d8-2697-4c4f-ac87-47c89087eccb tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:06.814904 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e4f58d8-2697-4c4f-ac87-47c89087eccb tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:06.815697 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e4f58d8-2697-4c4f-ac87-47c89087eccb tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:06.816132 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e4f58d8-2697-4c4f-ac87-47c89087eccb tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:06.883413 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3e4f58d8-2697-4c4f-ac87-47c89087eccb tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:06.891898 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3e4f58d8-2697-4c4f-ac87-47c89087eccb tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:06.893886 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3e4f58d8-2697-4c4f-ac87-47c89087eccb tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:06.895126 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3e4f58d8-2697-4c4f-ac87-47c89087eccb tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1340 microversion: 2.20 time: 0.093099 Jul 07 07:25:06.895740 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 304/620] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:06 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:07.029699 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e07dbc9f-d2b7-4f9f-bce0-3e5c219c5b75 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:07.030413 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e07dbc9f-d2b7-4f9f-bce0-3e5c219c5b75 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:07.037176 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e07dbc9f-d2b7-4f9f-bce0-3e5c219c5b75 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:07.037718 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e07dbc9f-d2b7-4f9f-bce0-3e5c219c5b75 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:07.038734 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e07dbc9f-d2b7-4f9f-bce0-3e5c219c5b75 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:07.039353 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e07dbc9f-d2b7-4f9f-bce0-3e5c219c5b75 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:07.277608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0fd7ff25-f05c-47ba-bca0-6b32bc6a4780 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:07.278379 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0fd7ff25-f05c-47ba-bca0-6b32bc6a4780 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:07.285513 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e07dbc9f-d2b7-4f9f-bce0-3e5c219c5b75 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:07.288368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0fd7ff25-f05c-47ba-bca0-6b32bc6a4780 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:07.289161 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0fd7ff25-f05c-47ba-bca0-6b32bc6a4780 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:07.290625 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0fd7ff25-f05c-47ba-bca0-6b32bc6a4780 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:07.292176 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0fd7ff25-f05c-47ba-bca0-6b32bc6a4780 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:07.295568 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e07dbc9f-d2b7-4f9f-bce0-3e5c219c5b75 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1755 microversion: 2.1 time: 0.270125 Jul 07 07:25:07.296159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 317/621] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:07 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1755 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:07.428644 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0fd7ff25-f05c-47ba-bca0-6b32bc6a4780 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:07.437261 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0fd7ff25-f05c-47ba-bca0-6b32bc6a4780 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1363 microversion: 2.1 time: 0.164183 Jul 07 07:25:07.437852 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 305/622] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:07 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:25:07.913811 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-000c09cb-2c2b-496d-906b-1de684b550d7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:07.914482 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-000c09cb-2c2b-496d-906b-1de684b550d7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:07.920831 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-000c09cb-2c2b-496d-906b-1de684b550d7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:07.921303 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-000c09cb-2c2b-496d-906b-1de684b550d7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:07.922073 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-000c09cb-2c2b-496d-906b-1de684b550d7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:07.922498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-000c09cb-2c2b-496d-906b-1de684b550d7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:08.056330 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-000c09cb-2c2b-496d-906b-1de684b550d7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:08.065509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-000c09cb-2c2b-496d-906b-1de684b550d7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:08.067136 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-000c09cb-2c2b-496d-906b-1de684b550d7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:08.068251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-000c09cb-2c2b-496d-906b-1de684b550d7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1407 microversion: 2.20 time: 0.158363 Jul 07 07:25:08.068788 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 318/623] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:07 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:08.313790 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4057ac02-21f1-4053-aa5d-3b4b602b51ca tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:08.314392 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4057ac02-21f1-4053-aa5d-3b4b602b51ca tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:08.323784 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4057ac02-21f1-4053-aa5d-3b4b602b51ca tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:08.324418 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4057ac02-21f1-4053-aa5d-3b4b602b51ca tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:08.325368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4057ac02-21f1-4053-aa5d-3b4b602b51ca tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:08.325818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4057ac02-21f1-4053-aa5d-3b4b602b51ca tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:08.454498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6a4219ec-47f3-4169-9ed7-fecb37606812 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:08.455129 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6a4219ec-47f3-4169-9ed7-fecb37606812 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:08.462724 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a4219ec-47f3-4169-9ed7-fecb37606812 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:08.463195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a4219ec-47f3-4169-9ed7-fecb37606812 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:08.464001 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a4219ec-47f3-4169-9ed7-fecb37606812 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:08.464438 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6a4219ec-47f3-4169-9ed7-fecb37606812 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:08.486941 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4057ac02-21f1-4053-aa5d-3b4b602b51ca tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:08.495739 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4057ac02-21f1-4053-aa5d-3b4b602b51ca tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1755 microversion: 2.1 time: 0.186326 Jul 07 07:25:08.496335 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 306/624] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:08 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:08.642774 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6a4219ec-47f3-4169-9ed7-fecb37606812 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:08.651038 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6a4219ec-47f3-4169-9ed7-fecb37606812 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1363 microversion: 2.1 time: 0.200521 Jul 07 07:25:08.651876 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 319/625] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:08 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:25:08.754966 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-fdb7c7a6-9945-47a1-871b-a2579bda0ffb req-a45cacfe-7409-4d18-ae6a-3541883f09f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb92117b-b521-46c1-bbef-7e97a808bab8", "tag": "304ba8c6-1b84-41a1-aaca-b548534ce32b"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:08.767332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-fdb7c7a6-9945-47a1-871b-a2579bda0ffb req-a45cacfe-7409-4d18-ae6a-3541883f09f9 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:08.768001 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-fdb7c7a6-9945-47a1-871b-a2579bda0ffb req-a45cacfe-7409-4d18-ae6a-3541883f09f9 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:08.790753 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-fdb7c7a6-9945-47a1-871b-a2579bda0ffb req-a45cacfe-7409-4d18-ae6a-3541883f09f9 service nova] Creating event network-changed:304ba8c6-1b84-41a1-aaca-b548534ce32b for instance eb92117b-b521-46c1-bbef-7e97a808bab8 on hv-cinder-82660 Jul 07 07:25:08.796040 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-fdb7c7a6-9945-47a1-871b-a2579bda0ffb req-a45cacfe-7409-4d18-ae6a-3541883f09f9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044973 Jul 07 07:25:08.796660 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 307/626] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:25:09.087150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4e36123d-0d4e-486c-9137-ea7fcb9d038c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:09.087765 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4e36123d-0d4e-486c-9137-ea7fcb9d038c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:09.095056 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e36123d-0d4e-486c-9137-ea7fcb9d038c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:09.095510 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e36123d-0d4e-486c-9137-ea7fcb9d038c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:09.096301 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e36123d-0d4e-486c-9137-ea7fcb9d038c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:09.096764 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e36123d-0d4e-486c-9137-ea7fcb9d038c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:09.240072 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4e36123d-0d4e-486c-9137-ea7fcb9d038c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:09.248231 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4e36123d-0d4e-486c-9137-ea7fcb9d038c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:09.249775 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4e36123d-0d4e-486c-9137-ea7fcb9d038c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:09.250893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4e36123d-0d4e-486c-9137-ea7fcb9d038c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1407 microversion: 2.20 time: 0.168050 Jul 07 07:25:09.251462 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 320/627] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:09 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:09.517817 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-223d3d87-2de6-49eb-bc2d-cfba43d0a298 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:09.518808 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-223d3d87-2de6-49eb-bc2d-cfba43d0a298 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:09.527868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-223d3d87-2de6-49eb-bc2d-cfba43d0a298 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:09.528517 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-223d3d87-2de6-49eb-bc2d-cfba43d0a298 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:09.529655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-223d3d87-2de6-49eb-bc2d-cfba43d0a298 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:09.530278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-223d3d87-2de6-49eb-bc2d-cfba43d0a298 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:09.670242 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7b1189c4-e553-491b-a207-5340fbbe3a68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:09.670878 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7b1189c4-e553-491b-a207-5340fbbe3a68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:09.678076 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b1189c4-e553-491b-a207-5340fbbe3a68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:09.678946 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b1189c4-e553-491b-a207-5340fbbe3a68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:09.679280 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b1189c4-e553-491b-a207-5340fbbe3a68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:09.679811 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7b1189c4-e553-491b-a207-5340fbbe3a68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:09.691602 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-223d3d87-2de6-49eb-bc2d-cfba43d0a298 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:09.699748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-223d3d87-2de6-49eb-bc2d-cfba43d0a298 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1755 microversion: 2.1 time: 0.188624 Jul 07 07:25:09.700310 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 308/628] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:09 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:09.813286 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7b1189c4-e553-491b-a207-5340fbbe3a68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:09.820910 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7b1189c4-e553-491b-a207-5340fbbe3a68 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1363 microversion: 2.1 time: 0.154730 Jul 07 07:25:09.821657 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 321/629] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:09 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:10.272368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6aa32767-4ef0-4ab6-b2d0-cf365552d0d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:10.273024 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6aa32767-4ef0-4ab6-b2d0-cf365552d0d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:10.281783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6aa32767-4ef0-4ab6-b2d0-cf365552d0d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:10.282432 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6aa32767-4ef0-4ab6-b2d0-cf365552d0d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:10.283513 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6aa32767-4ef0-4ab6-b2d0-cf365552d0d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:10.284069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6aa32767-4ef0-4ab6-b2d0-cf365552d0d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:10.433437 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6aa32767-4ef0-4ab6-b2d0-cf365552d0d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:10.441878 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6aa32767-4ef0-4ab6-b2d0-cf365552d0d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:10.443390 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6aa32767-4ef0-4ab6-b2d0-cf365552d0d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:10.444552 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6aa32767-4ef0-4ab6-b2d0-cf365552d0d9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1407 microversion: 2.20 time: 0.178980 Jul 07 07:25:10.445143 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 309/630] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:10 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:10.717042 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-48186738-593d-459c-8890-2fafadbcd21e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:10.717724 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-48186738-593d-459c-8890-2fafadbcd21e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:10.725202 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48186738-593d-459c-8890-2fafadbcd21e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:10.725812 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48186738-593d-459c-8890-2fafadbcd21e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:10.726459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48186738-593d-459c-8890-2fafadbcd21e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:10.726886 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48186738-593d-459c-8890-2fafadbcd21e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:10.731034 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:10.840195 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c5dbf7a6-84fc-4815-a732-b2b18d1be015 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:10.841050 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c5dbf7a6-84fc-4815-a732-b2b18d1be015 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:10.848324 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5dbf7a6-84fc-4815-a732-b2b18d1be015 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:10.848894 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5dbf7a6-84fc-4815-a732-b2b18d1be015 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:10.849961 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5dbf7a6-84fc-4815-a732-b2b18d1be015 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:10.850620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c5dbf7a6-84fc-4815-a732-b2b18d1be015 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:10.882297 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-48186738-593d-459c-8890-2fafadbcd21e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:10.892440 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-48186738-593d-459c-8890-2fafadbcd21e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1755 microversion: 2.1 time: 0.179219 Jul 07 07:25:10.892965 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 322/631] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:10 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:10.996736 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c5dbf7a6-84fc-4815-a732-b2b18d1be015 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:11.004823 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c5dbf7a6-84fc-4815-a732-b2b18d1be015 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1363 microversion: 2.1 time: 0.168685 Jul 07 07:25:11.005451 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 310/632] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:10 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:25:11.463259 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a742f00a-03b2-4761-9014-8cd70f9ce88a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:11.463852 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a742f00a-03b2-4761-9014-8cd70f9ce88a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:11.470860 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a742f00a-03b2-4761-9014-8cd70f9ce88a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:11.471302 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a742f00a-03b2-4761-9014-8cd70f9ce88a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:11.472092 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a742f00a-03b2-4761-9014-8cd70f9ce88a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:11.472628 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a742f00a-03b2-4761-9014-8cd70f9ce88a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:11.606898 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a742f00a-03b2-4761-9014-8cd70f9ce88a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:11.619010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a742f00a-03b2-4761-9014-8cd70f9ce88a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:11.620794 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a742f00a-03b2-4761-9014-8cd70f9ce88a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:11.622476 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a742f00a-03b2-4761-9014-8cd70f9ce88a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1407 microversion: 2.20 time: 0.163021 Jul 07 07:25:11.623271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 323/633] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:11 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:11.913792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bb5e9276-8ebd-4058-bdeb-53730a57d8cc tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:11.914417 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bb5e9276-8ebd-4058-bdeb-53730a57d8cc tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:11.921649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb5e9276-8ebd-4058-bdeb-53730a57d8cc tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:11.922112 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb5e9276-8ebd-4058-bdeb-53730a57d8cc tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:11.922910 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb5e9276-8ebd-4058-bdeb-53730a57d8cc tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:11.923346 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bb5e9276-8ebd-4058-bdeb-53730a57d8cc tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:12.019497 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-d85d1742-5aa9-45cd-90fd-19c473be582f req-f47a3e57-fc89-4e1f-83f7-028b7f1bb4dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14904778-9fa1-42ab-9f55-44a650b96877", "name": "network-vif-plugged", "status": "completed", "tag": "8e8e0c70-6136-45d2-8c16-1484b1913b94"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:12.029586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-d85d1742-5aa9-45cd-90fd-19c473be582f req-f47a3e57-fc89-4e1f-83f7-028b7f1bb4dd service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:12.030036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-d85d1742-5aa9-45cd-90fd-19c473be582f req-f47a3e57-fc89-4e1f-83f7-028b7f1bb4dd service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:12.044555 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-d85d1742-5aa9-45cd-90fd-19c473be582f req-f47a3e57-fc89-4e1f-83f7-028b7f1bb4dd service nova] Creating event network-vif-plugged:8e8e0c70-6136-45d2-8c16-1484b1913b94 for instance 14904778-9fa1-42ab-9f55-44a650b96877 on hv-cinder-82660 Jul 07 07:25:12.049963 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-d85d1742-5aa9-45cd-90fd-19c473be582f req-f47a3e57-fc89-4e1f-83f7-028b7f1bb4dd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034315 Jul 07 07:25:12.050587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 324/634] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:12.056039 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-00322b9d-6257-4991-94ce-48aa913e8db3 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:12.056739 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-00322b9d-6257-4991-94ce-48aa913e8db3 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:12.063876 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00322b9d-6257-4991-94ce-48aa913e8db3 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:12.064615 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00322b9d-6257-4991-94ce-48aa913e8db3 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:12.065927 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00322b9d-6257-4991-94ce-48aa913e8db3 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:12.066348 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-00322b9d-6257-4991-94ce-48aa913e8db3 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:12.084619 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bb5e9276-8ebd-4058-bdeb-53730a57d8cc tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:12.092892 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bb5e9276-8ebd-4058-bdeb-53730a57d8cc tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1758 microversion: 2.1 time: 0.186132 Jul 07 07:25:12.093523 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 311/635] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:11 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:12.214518 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-00322b9d-6257-4991-94ce-48aa913e8db3 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:12.222556 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-00322b9d-6257-4991-94ce-48aa913e8db3 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1363 microversion: 2.1 time: 0.170521 Jul 07 07:25:12.223336 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 325/636] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:12 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:12.641365 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d331d1fe-5f00-43b0-97e9-6a2281a9c8e0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:12.641908 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d331d1fe-5f00-43b0-97e9-6a2281a9c8e0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:12.644126 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:12.644851 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:12.651782 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d331d1fe-5f00-43b0-97e9-6a2281a9c8e0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:12.652242 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d331d1fe-5f00-43b0-97e9-6a2281a9c8e0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:12.653025 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d331d1fe-5f00-43b0-97e9-6a2281a9c8e0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:12.653488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d331d1fe-5f00-43b0-97e9-6a2281a9c8e0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:12.800045 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d331d1fe-5f00-43b0-97e9-6a2281a9c8e0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:12.808517 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d331d1fe-5f00-43b0-97e9-6a2281a9c8e0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:12.810378 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d331d1fe-5f00-43b0-97e9-6a2281a9c8e0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:12.811488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d331d1fe-5f00-43b0-97e9-6a2281a9c8e0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1407 microversion: 2.20 time: 0.174438 Jul 07 07:25:12.812043 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 312/637] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:12 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:13.242181 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0b101199-e8a5-4574-8688-260e3da04e09 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:13.242802 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0b101199-e8a5-4574-8688-260e3da04e09 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:13.249986 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0b101199-e8a5-4574-8688-260e3da04e09 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:13.250434 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0b101199-e8a5-4574-8688-260e3da04e09 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:13.251211 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0b101199-e8a5-4574-8688-260e3da04e09 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:13.251638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0b101199-e8a5-4574-8688-260e3da04e09 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:13.399462 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0b101199-e8a5-4574-8688-260e3da04e09 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:13.407876 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0b101199-e8a5-4574-8688-260e3da04e09 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1363 microversion: 2.1 time: 0.169811 Jul 07 07:25:13.408573 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 326/638] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:13 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:13.517373 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5e261d6d-f405-48d5-84be-5db50601d70c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:13.518099 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5e261d6d-f405-48d5-84be-5db50601d70c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:13.525958 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e261d6d-f405-48d5-84be-5db50601d70c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:13.526412 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e261d6d-f405-48d5-84be-5db50601d70c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:13.527187 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e261d6d-f405-48d5-84be-5db50601d70c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:13.527606 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5e261d6d-f405-48d5-84be-5db50601d70c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:13.553031 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5e261d6d-f405-48d5-84be-5db50601d70c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/ips" status: 200 len: 150 microversion: 2.1 time: 0.041352 Jul 07 07:25:13.553624 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 313/639] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Jul 7 07:25:13 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:13.830630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fdf7e366-b7e9-412d-9456-120c13deff52 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:13.831188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fdf7e366-b7e9-412d-9456-120c13deff52 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:13.837550 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdf7e366-b7e9-412d-9456-120c13deff52 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:13.837995 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdf7e366-b7e9-412d-9456-120c13deff52 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:13.838760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdf7e366-b7e9-412d-9456-120c13deff52 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:13.839186 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fdf7e366-b7e9-412d-9456-120c13deff52 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:13.972726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fdf7e366-b7e9-412d-9456-120c13deff52 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:13.981421 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fdf7e366-b7e9-412d-9456-120c13deff52 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:13.982925 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fdf7e366-b7e9-412d-9456-120c13deff52 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:13.984269 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fdf7e366-b7e9-412d-9456-120c13deff52 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1407 microversion: 2.20 time: 0.157799 Jul 07 07:25:13.984845 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 327/640] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:13 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:14.425505 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fbf4c3f2-09f5-4a57-a209-4df7609a07d2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:14.426109 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fbf4c3f2-09f5-4a57-a209-4df7609a07d2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:14.432703 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fbf4c3f2-09f5-4a57-a209-4df7609a07d2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:14.433314 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fbf4c3f2-09f5-4a57-a209-4df7609a07d2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:14.434036 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fbf4c3f2-09f5-4a57-a209-4df7609a07d2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:14.434804 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fbf4c3f2-09f5-4a57-a209-4df7609a07d2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:14.570614 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fbf4c3f2-09f5-4a57-a209-4df7609a07d2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:14.578259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fbf4c3f2-09f5-4a57-a209-4df7609a07d2 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1550 microversion: 2.1 time: 0.156730 Jul 07 07:25:14.578823 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 314/641] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:14 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:14.594753 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ad0d2dfe-0859-48b4-82cb-36ce98157085 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:14.595301 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ad0d2dfe-0859-48b4-82cb-36ce98157085 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:14.597858 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:14.603409 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad0d2dfe-0859-48b4-82cb-36ce98157085 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:14.603853 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad0d2dfe-0859-48b4-82cb-36ce98157085 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:14.604588 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad0d2dfe-0859-48b4-82cb-36ce98157085 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:14.605017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad0d2dfe-0859-48b4-82cb-36ce98157085 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:14.662813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=18 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:14.687217 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ad0d2dfe-0859-48b4-82cb-36ce98157085 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096288 Jul 07 07:25:14.687822 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 328/642] 10.222.0.62 () {58 vars in 1274 bytes} [Thu Jul 7 07:25:14 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:14.885657 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-70030424-4868-4340-89f5-a6ee6590a640 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:14.886945 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-70030424-4868-4340-89f5-a6ee6590a640 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:14.893464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70030424-4868-4340-89f5-a6ee6590a640 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:14.893922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70030424-4868-4340-89f5-a6ee6590a640 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:14.894712 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70030424-4868-4340-89f5-a6ee6590a640 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:14.895155 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-70030424-4868-4340-89f5-a6ee6590a640 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:14.913178 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=100 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:15.003700 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3473ae18-cbba-4961-b8e5-773483117ecd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:15.004719 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3473ae18-cbba-4961-b8e5-773483117ecd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:15.011177 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3473ae18-cbba-4961-b8e5-773483117ecd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:15.011687 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3473ae18-cbba-4961-b8e5-773483117ecd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:15.013807 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3473ae18-cbba-4961-b8e5-773483117ecd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:15.014242 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3473ae18-cbba-4961-b8e5-773483117ecd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:15.188720 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-70030424-4868-4340-89f5-a6ee6590a640 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309105 Jul 07 07:25:15.189562 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 315/643] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:25:14 2022] POST /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:15.269813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3473ae18-cbba-4961-b8e5-773483117ecd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:15.277907 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3473ae18-cbba-4961-b8e5-773483117ecd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:15.279767 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3473ae18-cbba-4961-b8e5-773483117ecd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:15.280815 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3473ae18-cbba-4961-b8e5-773483117ecd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1407 microversion: 2.20 time: 0.281065 Jul 07 07:25:15.281634 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 329/644] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:14 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:25:15.760022 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-808c5af3-afb2-4916-a19e-0221ba473c5d req-263eaaad-223b-48c5-8dad-9de686ccb15e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14904778-9fa1-42ab-9f55-44a650b96877", "tag": "8e8e0c70-6136-45d2-8c16-1484b1913b94"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:15.769578 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-808c5af3-afb2-4916-a19e-0221ba473c5d req-263eaaad-223b-48c5-8dad-9de686ccb15e service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:15.770023 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-808c5af3-afb2-4916-a19e-0221ba473c5d req-263eaaad-223b-48c5-8dad-9de686ccb15e service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:15.781120 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-808c5af3-afb2-4916-a19e-0221ba473c5d req-263eaaad-223b-48c5-8dad-9de686ccb15e service nova] Creating event network-changed:8e8e0c70-6136-45d2-8c16-1484b1913b94 for instance 14904778-9fa1-42ab-9f55-44a650b96877 on hv-cinder-82660 Jul 07 07:25:15.787143 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-808c5af3-afb2-4916-a19e-0221ba473c5d req-263eaaad-223b-48c5-8dad-9de686ccb15e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030765 Jul 07 07:25:15.787406 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 316/645] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:16.067366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-6734d2b9-5a83-4a2e-8542-fc77f21a511b req-f6a30bf4-d29f-4fb1-aac4-100fbb867b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb92117b-b521-46c1-bbef-7e97a808bab8", "name": "network-vif-plugged", "status": "completed", "tag": "304ba8c6-1b84-41a1-aaca-b548534ce32b"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:16.076537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-6734d2b9-5a83-4a2e-8542-fc77f21a511b req-f6a30bf4-d29f-4fb1-aac4-100fbb867b5f service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:16.077031 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-6734d2b9-5a83-4a2e-8542-fc77f21a511b req-f6a30bf4-d29f-4fb1-aac4-100fbb867b5f service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:16.091377 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-6734d2b9-5a83-4a2e-8542-fc77f21a511b req-f6a30bf4-d29f-4fb1-aac4-100fbb867b5f service nova] Creating event network-vif-plugged:304ba8c6-1b84-41a1-aaca-b548534ce32b for instance eb92117b-b521-46c1-bbef-7e97a808bab8 on hv-cinder-82660 Jul 07 07:25:16.097061 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-6734d2b9-5a83-4a2e-8542-fc77f21a511b req-f6a30bf4-d29f-4fb1-aac4-100fbb867b5f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034053 Jul 07 07:25:16.097873 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 330/646] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:16.300890 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a53be454-b721-4ec3-b7da-d698c8e87592 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:16.301795 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a53be454-b721-4ec3-b7da-d698c8e87592 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:16.309604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a53be454-b721-4ec3-b7da-d698c8e87592 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:16.310240 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a53be454-b721-4ec3-b7da-d698c8e87592 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:16.311335 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a53be454-b721-4ec3-b7da-d698c8e87592 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:16.311968 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a53be454-b721-4ec3-b7da-d698c8e87592 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:16.477268 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a53be454-b721-4ec3-b7da-d698c8e87592 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:16.493876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a53be454-b721-4ec3-b7da-d698c8e87592 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:16.495936 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a53be454-b721-4ec3-b7da-d698c8e87592 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:16.498322 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a53be454-b721-4ec3-b7da-d698c8e87592 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1407 microversion: 2.20 time: 0.202389 Jul 07 07:25:16.499560 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 317/647] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:16 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:17.523126 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f5e60c86-b46d-42d5-acfe-3c1f086c101f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:17.524013 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f5e60c86-b46d-42d5-acfe-3c1f086c101f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:17.533689 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f5e60c86-b46d-42d5-acfe-3c1f086c101f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:17.534332 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f5e60c86-b46d-42d5-acfe-3c1f086c101f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:17.535509 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f5e60c86-b46d-42d5-acfe-3c1f086c101f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:17.536063 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f5e60c86-b46d-42d5-acfe-3c1f086c101f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:17.844624 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f5e60c86-b46d-42d5-acfe-3c1f086c101f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:17.853381 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f5e60c86-b46d-42d5-acfe-3c1f086c101f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:17.854899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f5e60c86-b46d-42d5-acfe-3c1f086c101f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:17.856018 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f5e60c86-b46d-42d5-acfe-3c1f086c101f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1407 microversion: 2.20 time: 0.340691 Jul 07 07:25:17.856579 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 331/648] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:17 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:18.498471 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b71dda88-e867-4fa3-bc20-7c193a8a4fdc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:18.499944 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b71dda88-e867-4fa3-bc20-7c193a8a4fdc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:18.508835 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b71dda88-e867-4fa3-bc20-7c193a8a4fdc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:18.509320 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b71dda88-e867-4fa3-bc20-7c193a8a4fdc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:18.510096 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b71dda88-e867-4fa3-bc20-7c193a8a4fdc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:18.510536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b71dda88-e867-4fa3-bc20-7c193a8a4fdc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:18.598134 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-b71dda88-e867-4fa3-bc20-7c193a8a4fdc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Invalid volume: volume 02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6 is already attached to instances: 63316553-0499-415e-82f5-27b303818561 Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b71dda88-e867-4fa3-bc20-7c193a8a4fdc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: POST /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments HTTP/1.1 Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 74 Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:25:18.599863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {"volumeAttachment": {"volumeId": "02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6"}} Jul 07 07:25:18.601414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Invalid volume: volume 02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6 is already attached to instances: 63316553-0499-415e-82f5-27b303818561 Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'server_id': '63316553-0499-415e-82f5-27b303818561', 'body': {'volumeAttachment': {'volumeId': '02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6'}}} Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6 is already attached to instances: 63316553-0499-415e-82f5-27b303818561 Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:18.602280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6 is already attached to instances: 63316553-0499-415e-82f5-27b303818561 Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:18.604702 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:18.606116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:18.606116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:25:18.606116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:25:18.606116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6 is already attached to instances: 63316553-0499-415e-82f5-27b303818561 Jul 07 07:25:18.606116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:18.606116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b71dda88-e867-4fa3-bc20-7c193a8a4fdc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 400 to user: Invalid volume: volume 02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6 is already attached to instances: 63316553-0499-415e-82f5-27b303818561 {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:25:18.606116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b71dda88-e867-4fa3-bc20-7c193a8a4fdc tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109518 Jul 07 07:25:18.606116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 318/649] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:25:18 2022] POST /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 07 07:25:18.668075 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-60efae29-da05-424c-85a8-fa680e669bb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:18.668568 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-60efae29-da05-424c-85a8-fa680e669bb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:18.675238 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60efae29-da05-424c-85a8-fa680e669bb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:18.675690 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60efae29-da05-424c-85a8-fa680e669bb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:18.676506 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60efae29-da05-424c-85a8-fa680e669bb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:18.676978 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-60efae29-da05-424c-85a8-fa680e669bb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:18.771763 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-60efae29-da05-424c-85a8-fa680e669bb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lazy-loading 'services' on Instance uuid 63316553-0499-415e-82f5-27b303818561 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:25:18.849279 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-60efae29-da05-424c-85a8-fa680e669bb4 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments/02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6" status: 202 len: 0 microversion: 2.1 time: 0.184942 Jul 07 07:25:18.849861 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 332/650] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:25:18 2022] DELETE /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments/02447fa9-cbc1-4dbb-b535-dbb6b2d8b7d6 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 07:25:18.858330 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ccc1e061-d57e-4f6f-b13b-fbc456c2da87 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:18.859321 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ccc1e061-d57e-4f6f-b13b-fbc456c2da87 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:18.866444 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ccc1e061-d57e-4f6f-b13b-fbc456c2da87 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:18.866880 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ccc1e061-d57e-4f6f-b13b-fbc456c2da87 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:18.867824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ccc1e061-d57e-4f6f-b13b-fbc456c2da87 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:18.868252 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ccc1e061-d57e-4f6f-b13b-fbc456c2da87 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:18.875882 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6ba2432a-4f0b-43ff-8857-667955ee5cc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:18.876726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6ba2432a-4f0b-43ff-8857-667955ee5cc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:18.883474 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ba2432a-4f0b-43ff-8857-667955ee5cc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:18.883926 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ba2432a-4f0b-43ff-8857-667955ee5cc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:18.885383 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ba2432a-4f0b-43ff-8857-667955ee5cc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:18.885754 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6ba2432a-4f0b-43ff-8857-667955ee5cc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:18.899523 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ccc1e061-d57e-4f6f-b13b-fbc456c2da87 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045135 Jul 07 07:25:18.900087 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 319/651] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:25:18 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:19.021781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ba2432a-4f0b-43ff-8857-667955ee5cc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:19.031963 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ba2432a-4f0b-43ff-8857-667955ee5cc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:19.033506 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6ba2432a-4f0b-43ff-8857-667955ee5cc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:19.034611 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6ba2432a-4f0b-43ff-8857-667955ee5cc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1407 microversion: 2.20 time: 0.163474 Jul 07 07:25:19.035161 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 333/652] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:18 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:19.914112 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c4f639e0-9f63-4f8a-b9bf-bf5daac2ff80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:19.915035 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c4f639e0-9f63-4f8a-b9bf-bf5daac2ff80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:19.922593 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4f639e0-9f63-4f8a-b9bf-bf5daac2ff80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:19.923490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4f639e0-9f63-4f8a-b9bf-bf5daac2ff80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:19.923893 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4f639e0-9f63-4f8a-b9bf-bf5daac2ff80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:19.924319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4f639e0-9f63-4f8a-b9bf-bf5daac2ff80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:19.956906 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c4f639e0-9f63-4f8a-b9bf-bf5daac2ff80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048222 Jul 07 07:25:19.957590 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 320/653] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:25:19 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:20.053483 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ca658d07-0984-4d00-a4a7-f6bd5eb9b395 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:20.054142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ca658d07-0984-4d00-a4a7-f6bd5eb9b395 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:20.061542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca658d07-0984-4d00-a4a7-f6bd5eb9b395 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:20.062005 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca658d07-0984-4d00-a4a7-f6bd5eb9b395 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:20.062800 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca658d07-0984-4d00-a4a7-f6bd5eb9b395 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:20.063279 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ca658d07-0984-4d00-a4a7-f6bd5eb9b395 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:20.210370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ca658d07-0984-4d00-a4a7-f6bd5eb9b395 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:20.218685 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ca658d07-0984-4d00-a4a7-f6bd5eb9b395 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:20.220186 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ca658d07-0984-4d00-a4a7-f6bd5eb9b395 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:20.221464 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ca658d07-0984-4d00-a4a7-f6bd5eb9b395 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1599 microversion: 2.20 time: 0.172054 Jul 07 07:25:20.222093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 334/654] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:25:20 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:25:20.239805 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-46788454-4d0e-44fe-a885-826fdd46558d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:20.240309 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-46788454-4d0e-44fe-a885-826fdd46558d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:20.246721 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46788454-4d0e-44fe-a885-826fdd46558d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:20.247172 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46788454-4d0e-44fe-a885-826fdd46558d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:20.248012 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46788454-4d0e-44fe-a885-826fdd46558d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:20.248464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-46788454-4d0e-44fe-a885-826fdd46558d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:20.333521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-46788454-4d0e-44fe-a885-826fdd46558d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097943 Jul 07 07:25:20.334379 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 321/655] 10.222.0.62 () {60 vars in 1315 bytes} [Thu Jul 7 07:25:20 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:25:20.968272 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2ecb1785-f476-44fc-970c-8974f019d602 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:20.969456 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2ecb1785-f476-44fc-970c-8974f019d602 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:20.976050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ecb1785-f476-44fc-970c-8974f019d602 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:20.976505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ecb1785-f476-44fc-970c-8974f019d602 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:20.977351 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ecb1785-f476-44fc-970c-8974f019d602 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:20.977790 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2ecb1785-f476-44fc-970c-8974f019d602 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:21.008176 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2ecb1785-f476-44fc-970c-8974f019d602 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043842 Jul 07 07:25:21.008764 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 335/656] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:25:20 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 07:25:21.067300 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2ff3fed5-a0af-4d83-a5b9-536946984021 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:21.067877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2ff3fed5-a0af-4d83-a5b9-536946984021 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:21.075602 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ff3fed5-a0af-4d83-a5b9-536946984021 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:21.076137 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ff3fed5-a0af-4d83-a5b9-536946984021 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:21.076982 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ff3fed5-a0af-4d83-a5b9-536946984021 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:21.077532 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2ff3fed5-a0af-4d83-a5b9-536946984021 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:21.106706 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2ff3fed5-a0af-4d83-a5b9-536946984021 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:25:21.192855 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2ff3fed5-a0af-4d83-a5b9-536946984021 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 204 len: 0 microversion: 2.1 time: 0.130032 Jul 07 07:25:21.193824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 322/657] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:25:21 2022] DELETE /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:25:21.201832 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-747663ef-cdab-480a-b7d4-203211f9f621 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:21.202439 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-747663ef-cdab-480a-b7d4-203211f9f621 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:21.204863 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:21.210553 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-747663ef-cdab-480a-b7d4-203211f9f621 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:21.210996 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-747663ef-cdab-480a-b7d4-203211f9f621 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:21.211765 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-747663ef-cdab-480a-b7d4-203211f9f621 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:21.212201 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-747663ef-cdab-480a-b7d4-203211f9f621 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:21.320127 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-b6bcacec-9b32-4b5d-89c9-43d5af4d5456 req-d710159d-908e-4011-9c0f-5caf865e609a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb92117b-b521-46c1-bbef-7e97a808bab8", "tag": "304ba8c6-1b84-41a1-aaca-b548534ce32b"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:21.329413 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b6bcacec-9b32-4b5d-89c9-43d5af4d5456 req-d710159d-908e-4011-9c0f-5caf865e609a service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:21.330148 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-b6bcacec-9b32-4b5d-89c9-43d5af4d5456 req-d710159d-908e-4011-9c0f-5caf865e609a service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:21.342639 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-b6bcacec-9b32-4b5d-89c9-43d5af4d5456 req-d710159d-908e-4011-9c0f-5caf865e609a service nova] Creating event network-changed:304ba8c6-1b84-41a1-aaca-b548534ce32b for instance eb92117b-b521-46c1-bbef-7e97a808bab8 on hv-cinder-82660 Jul 07 07:25:21.351146 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-747663ef-cdab-480a-b7d4-203211f9f621 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:21.352542 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-b6bcacec-9b32-4b5d-89c9-43d5af4d5456 req-d710159d-908e-4011-9c0f-5caf865e609a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036441 Jul 07 07:25:21.353393 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 323/658] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:21.359325 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-747663ef-cdab-480a-b7d4-203211f9f621 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1679 microversion: 2.1 time: 0.161095 Jul 07 07:25:21.359907 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 336/659] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:21 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:25:22.383110 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b76bf9bf-df62-40d1-99f2-721060336e88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:22.384523 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b76bf9bf-df62-40d1-99f2-721060336e88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:22.391996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b76bf9bf-df62-40d1-99f2-721060336e88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:22.392455 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b76bf9bf-df62-40d1-99f2-721060336e88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:22.393235 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b76bf9bf-df62-40d1-99f2-721060336e88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:22.393871 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b76bf9bf-df62-40d1-99f2-721060336e88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:22.544457 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b76bf9bf-df62-40d1-99f2-721060336e88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:22.554930 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b76bf9bf-df62-40d1-99f2-721060336e88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1679 microversion: 2.1 time: 0.176275 Jul 07 07:25:22.555477 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 324/660] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:22 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:23.575982 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8b2aab9a-6370-44f2-aedd-55256c28bd7e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:23.576696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8b2aab9a-6370-44f2-aedd-55256c28bd7e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:23.583902 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8b2aab9a-6370-44f2-aedd-55256c28bd7e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:23.584359 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8b2aab9a-6370-44f2-aedd-55256c28bd7e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:23.585142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8b2aab9a-6370-44f2-aedd-55256c28bd7e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:23.585613 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8b2aab9a-6370-44f2-aedd-55256c28bd7e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:23.723683 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8b2aab9a-6370-44f2-aedd-55256c28bd7e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:23.732956 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8b2aab9a-6370-44f2-aedd-55256c28bd7e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1679 microversion: 2.1 time: 0.160897 Jul 07 07:25:23.733558 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 337/661] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:23 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:24.278711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-f56a905f-fc73-4d06-917c-4783f07d5cf0 req-5aa3f202-a8e0-4c37-a7bb-860e1fecd106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63316553-0499-415e-82f5-27b303818561", "name": "network-vif-deleted", "tag": "48b2b8dd-3bb8-4d74-aa11-38876170e713"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:24.292270 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-f56a905f-fc73-4d06-917c-4783f07d5cf0 req-5aa3f202-a8e0-4c37-a7bb-860e1fecd106 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:24.292798 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-f56a905f-fc73-4d06-917c-4783f07d5cf0 req-5aa3f202-a8e0-4c37-a7bb-860e1fecd106 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:24.304577 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-f56a905f-fc73-4d06-917c-4783f07d5cf0 req-5aa3f202-a8e0-4c37-a7bb-860e1fecd106 service nova] Creating event network-vif-deleted:48b2b8dd-3bb8-4d74-aa11-38876170e713 for instance 63316553-0499-415e-82f5-27b303818561 on hv-cinder-82660 Jul 07 07:25:24.309894 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-f56a905f-fc73-4d06-917c-4783f07d5cf0 req-5aa3f202-a8e0-4c37-a7bb-860e1fecd106 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034575 Jul 07 07:25:24.310699 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 325/662] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:24.752394 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:24.752968 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:24.765836 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:24.766397 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:24.767184 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:24.767623 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:24.804958 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:24.805719 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:24.806188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lazy-loading 'fault' on Instance uuid 63316553-0499-415e-82f5-27b303818561 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:25:24.860523 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:24.871379 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c2592b14-3f93-4ba9-b175-03ee46870a00 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 200 len: 1330 microversion: 2.1 time: 0.124750 Jul 07 07:25:24.872335 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 338/663] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:24 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:25.958552 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cf733bf6-90ce-484e-b45f-9a37c5f12c2b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:25.959320 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cf733bf6-90ce-484e-b45f-9a37c5f12c2b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:25.965891 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf733bf6-90ce-484e-b45f-9a37c5f12c2b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:25.966334 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf733bf6-90ce-484e-b45f-9a37c5f12c2b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:25.967091 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf733bf6-90ce-484e-b45f-9a37c5f12c2b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:25.967514 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf733bf6-90ce-484e-b45f-9a37c5f12c2b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:25.981133 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-cf733bf6-90ce-484e-b45f-9a37c5f12c2b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cf733bf6-90ce-484e-b45f-9a37c5f12c2b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 HTTP/1.1 Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:25:25.982774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:25:25.984257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '63316553-0499-415e-82f5-27b303818561'} Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:25:25.985088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:25:25.986470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:25.987639 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cf733bf6-90ce-484e-b45f-9a37c5f12c2b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:25:25.987639 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cf733bf6-90ce-484e-b45f-9a37c5f12c2b tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 404 len: 111 microversion: 2.1 time: 0.094541 Jul 07 07:25:25.987639 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 326/664] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:25 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:25:25.993745 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6f20aa45-fddc-42b3-af67-e1658645b3ba tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '.version_select at 0x7fccf9fe89d0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:26.013071 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6f20aa45-fddc-42b3-af67-e1658645b3ba tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-527042178" status: 202 len: 0 microversion: 2.1 time: 0.023273 Jul 07 07:25:26.013674 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 339/665] 10.222.0.62 () {58 vars in 1217 bytes} [Thu Jul 7 07:25:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-527042178 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:25:26.672964 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-47e685a3-2aa0-4c75-8c49-1ba48f4ab7e2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: .version_select at 0x7fccfc67a790>, body: {"keypair": {"name": "tempest-keypair-1271886200", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVlMUuCDWdNIDscPNUPj7JzrMar7Hvi+tjKteOSA5hP1WcozYZZuLOsJpDbox/nqgrg38cEDVEr6pTAGz4PfG1Z7U+qFWt2ixU5LMGj6M12DvBiXYGjcZM3pNOspMp4/g=="}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:26.687556 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-47e685a3-2aa0-4c75-8c49-1ba48f4ab7e2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for project 883f7310b404427fa3ddda37a8d04acc. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:25:26.689816 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:26.692163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-47e685a3-2aa0-4c75-8c49-1ba48f4ab7e2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for user 58366850e234491cafe268bb56e9e3a1 and project 883f7310b404427fa3ddda37a8d04acc. Resources: {'key_pairs'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:25:26.723923 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-47e685a3-2aa0-4c75-8c49-1ba48f4ab7e2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055043 Jul 07 07:25:26.724511 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 327/666] 10.222.0.62 () {60 vars in 1158 bytes} [Thu Jul 7 07:25:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:28.246959 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1910139751", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9578812b-5d60-45a0-af5c-eccba67aa04b"}], "security_groups": [{"name": "tempest-securitygroup--969953986"}], "key_name": "tempest-keypair-1271886200", "user_data": "}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:28.359893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] validate_networks() for [('9578812b-5d60-45a0-af5c-eccba67aa04b', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:25:28.801059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:25:28.801688 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:25:28.802352 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:25:28.802963 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:25:28.803576 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:25:28.818204 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:28.818797 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:28.819741 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:28.820300 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:28.841205 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for project 883f7310b404427fa3ddda37a8d04acc. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:25:28.845719 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Getting quotas for user 58366850e234491cafe268bb56e9e3a1 and project 883f7310b404427fa3ddda37a8d04acc. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:25:28.857627 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:25:28.859922 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:25:28.907278 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4e264402-49b3-42d3-a870-c8ecf9deaf80 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.665341 Jul 07 07:25:28.907946 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 340/667] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:25:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:25:28.918955 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-68c0903d-78be-436b-9ee6-8d24bf7a8808 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:28.919567 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-68c0903d-78be-436b-9ee6-8d24bf7a8808 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:28.975389 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-68c0903d-78be-436b-9ee6-8d24bf7a8808 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:28.982962 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-68c0903d-78be-436b-9ee6-8d24bf7a8808 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1242 microversion: 2.1 time: 0.068429 Jul 07 07:25:28.984073 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 328/668] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:28 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:30.000385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4410ddaa-1a61-47bb-b831-a11b781f5d74 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:30.001136 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4410ddaa-1a61-47bb-b831-a11b781f5d74 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:30.008120 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4410ddaa-1a61-47bb-b831-a11b781f5d74 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:30.008596 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4410ddaa-1a61-47bb-b831-a11b781f5d74 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:30.009402 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4410ddaa-1a61-47bb-b831-a11b781f5d74 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:30.009820 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4410ddaa-1a61-47bb-b831-a11b781f5d74 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:30.014603 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:30.076498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-4410ddaa-1a61-47bb-b831-a11b781f5d74 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:30.085078 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4410ddaa-1a61-47bb-b831-a11b781f5d74 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1302 microversion: 2.1 time: 0.088594 Jul 07 07:25:30.085948 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 341/669] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:29 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:31.102928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a4036fc6-b582-469e-bdf6-aa966a6ce544 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:31.104391 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a4036fc6-b582-469e-bdf6-aa966a6ce544 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:31.111810 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4036fc6-b582-469e-bdf6-aa966a6ce544 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:31.112281 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4036fc6-b582-469e-bdf6-aa966a6ce544 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:31.113116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4036fc6-b582-469e-bdf6-aa966a6ce544 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:31.113865 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4036fc6-b582-469e-bdf6-aa966a6ce544 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:31.253617 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a4036fc6-b582-469e-bdf6-aa966a6ce544 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:31.261333 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a4036fc6-b582-469e-bdf6-aa966a6ce544 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.162389 Jul 07 07:25:31.261924 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 329/670] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:31 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:31.843847 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-a1a038ca-6a94-4b45-bcee-c266acdcd6aa req-4a39efd8-5a29-4e70-8b1d-40efd774eacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241d4c02-22a4-4c03-9cf1-9708f5de3922", "tag": "889f78e4-6681-40f3-bf13-bcf02b894624"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:31.868712 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a1a038ca-6a94-4b45-bcee-c266acdcd6aa req-4a39efd8-5a29-4e70-8b1d-40efd774eacd service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:31.869101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a1a038ca-6a94-4b45-bcee-c266acdcd6aa req-4a39efd8-5a29-4e70-8b1d-40efd774eacd service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:31.881716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-a1a038ca-6a94-4b45-bcee-c266acdcd6aa req-4a39efd8-5a29-4e70-8b1d-40efd774eacd service nova] Creating event network-changed:889f78e4-6681-40f3-bf13-bcf02b894624 for instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 on hv-cinder-82660 Jul 07 07:25:31.887002 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-a1a038ca-6a94-4b45-bcee-c266acdcd6aa req-4a39efd8-5a29-4e70-8b1d-40efd774eacd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046795 Jul 07 07:25:31.887609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 342/671] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:32.278873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e2aab2ca-d0d7-4f48-bf8f-49158f040a18 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:32.279470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e2aab2ca-d0d7-4f48-bf8f-49158f040a18 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:32.286334 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2aab2ca-d0d7-4f48-bf8f-49158f040a18 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:32.286785 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2aab2ca-d0d7-4f48-bf8f-49158f040a18 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:32.287553 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2aab2ca-d0d7-4f48-bf8f-49158f040a18 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:32.287988 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2aab2ca-d0d7-4f48-bf8f-49158f040a18 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:32.430224 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e2aab2ca-d0d7-4f48-bf8f-49158f040a18 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:32.438391 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e2aab2ca-d0d7-4f48-bf8f-49158f040a18 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.163539 Jul 07 07:25:32.438968 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 330/672] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:32 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:33.458940 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-321cdc38-fd4d-47ef-a795-554aee041853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:33.459657 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-321cdc38-fd4d-47ef-a795-554aee041853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:33.466727 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-321cdc38-fd4d-47ef-a795-554aee041853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:33.467274 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-321cdc38-fd4d-47ef-a795-554aee041853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:33.468058 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-321cdc38-fd4d-47ef-a795-554aee041853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:33.468498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-321cdc38-fd4d-47ef-a795-554aee041853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:33.606933 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-321cdc38-fd4d-47ef-a795-554aee041853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:33.614743 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-321cdc38-fd4d-47ef-a795-554aee041853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.163115 Jul 07 07:25:33.615326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 343/673] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:33 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:34.635492 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ff2a28d8-583f-450b-982a-d8180811c18d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:34.636275 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ff2a28d8-583f-450b-982a-d8180811c18d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:34.643331 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff2a28d8-583f-450b-982a-d8180811c18d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:34.643796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff2a28d8-583f-450b-982a-d8180811c18d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:34.644547 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff2a28d8-583f-450b-982a-d8180811c18d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:34.644980 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ff2a28d8-583f-450b-982a-d8180811c18d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:34.793959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ff2a28d8-583f-450b-982a-d8180811c18d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:34.801633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ff2a28d8-583f-450b-982a-d8180811c18d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.172452 Jul 07 07:25:34.802203 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 331/674] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:34 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:35.095448 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e35c91ac-9f7e-4bf4-b58b-5251ea934f00 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:35.096130 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e35c91ac-9f7e-4bf4-b58b-5251ea934f00 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:35.103195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e35c91ac-9f7e-4bf4-b58b-5251ea934f00 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:35.103685 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e35c91ac-9f7e-4bf4-b58b-5251ea934f00 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:35.104470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e35c91ac-9f7e-4bf4-b58b-5251ea934f00 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:35.104904 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e35c91ac-9f7e-4bf4-b58b-5251ea934f00 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:35.194367 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-e35c91ac-9f7e-4bf4-b58b-5251ea934f00 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lazy-loading 'services' on Instance uuid c68b9418-cc4f-41da-8dba-1ef31555120e {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:25:35.277927 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e35c91ac-9f7e-4bf4-b58b-5251ea934f00 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments/d2d187e9-633c-4355-bd32-4e5780cc6735" status: 202 len: 0 microversion: 2.1 time: 0.186476 Jul 07 07:25:35.278525 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 344/675] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:25:35 2022] DELETE /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments/d2d187e9-633c-4355-bd32-4e5780cc6735 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:25:35.287403 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3e75b0a3-6bac-471c-8cf0-d2a29087aaa8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:35.288421 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3e75b0a3-6bac-471c-8cf0-d2a29087aaa8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:35.295746 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e75b0a3-6bac-471c-8cf0-d2a29087aaa8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:35.296204 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e75b0a3-6bac-471c-8cf0-d2a29087aaa8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:35.297022 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e75b0a3-6bac-471c-8cf0-d2a29087aaa8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:35.297489 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3e75b0a3-6bac-471c-8cf0-d2a29087aaa8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:35.332268 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3e75b0a3-6bac-471c-8cf0-d2a29087aaa8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048253 Jul 07 07:25:35.332856 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 332/676] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:25:35 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:35.819967 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-585db198-9106-4b66-b6c1-04218a0c30ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:35.820651 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-585db198-9106-4b66-b6c1-04218a0c30ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:35.827562 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-585db198-9106-4b66-b6c1-04218a0c30ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:35.828009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-585db198-9106-4b66-b6c1-04218a0c30ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:35.828782 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-585db198-9106-4b66-b6c1-04218a0c30ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:35.829246 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-585db198-9106-4b66-b6c1-04218a0c30ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:35.973420 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-585db198-9106-4b66-b6c1-04218a0c30ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:35.982176 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-585db198-9106-4b66-b6c1-04218a0c30ec tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.166452 Jul 07 07:25:35.982763 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 345/677] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:35 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:36.343735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9844f3ad-7ba3-47e3-a870-93fef0010cc8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:36.344690 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9844f3ad-7ba3-47e3-a870-93fef0010cc8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:36.351751 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9844f3ad-7ba3-47e3-a870-93fef0010cc8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:36.352178 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9844f3ad-7ba3-47e3-a870-93fef0010cc8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:36.352995 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9844f3ad-7ba3-47e3-a870-93fef0010cc8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:36.353479 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9844f3ad-7ba3-47e3-a870-93fef0010cc8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:36.386414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9844f3ad-7ba3-47e3-a870-93fef0010cc8 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046562 Jul 07 07:25:36.386906 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 333/678] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:25:36 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:37.012836 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5e90952b-75d0-4f19-973f-5b065240d9c7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:37.013535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5e90952b-75d0-4f19-973f-5b065240d9c7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:37.020046 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e90952b-75d0-4f19-973f-5b065240d9c7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:37.020487 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e90952b-75d0-4f19-973f-5b065240d9c7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:37.021306 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e90952b-75d0-4f19-973f-5b065240d9c7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:37.021748 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5e90952b-75d0-4f19-973f-5b065240d9c7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:37.171187 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5e90952b-75d0-4f19-973f-5b065240d9c7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:37.178994 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5e90952b-75d0-4f19-973f-5b065240d9c7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.172531 Jul 07 07:25:37.179753 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 346/679] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:37 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:37.398821 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-00dd3687-1e04-480d-a7de-2fd371608676 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:37.399745 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-00dd3687-1e04-480d-a7de-2fd371608676 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:37.407202 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00dd3687-1e04-480d-a7de-2fd371608676 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:37.407657 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00dd3687-1e04-480d-a7de-2fd371608676 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:37.408569 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00dd3687-1e04-480d-a7de-2fd371608676 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:37.408920 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-00dd3687-1e04-480d-a7de-2fd371608676 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:37.413140 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:37.444436 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-00dd3687-1e04-480d-a7de-2fd371608676 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049871 Jul 07 07:25:37.445018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 334/680] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:25:37 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 07:25:37.529108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-4078eff9-b64c-47d0-8f59-4ca43d08ca89 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:37.529776 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4078eff9-b64c-47d0-8f59-4ca43d08ca89 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:37.536381 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4078eff9-b64c-47d0-8f59-4ca43d08ca89 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:37.536832 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4078eff9-b64c-47d0-8f59-4ca43d08ca89 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:37.537637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4078eff9-b64c-47d0-8f59-4ca43d08ca89 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:37.538070 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-4078eff9-b64c-47d0-8f59-4ca43d08ca89 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:37.567952 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-4078eff9-b64c-47d0-8f59-4ca43d08ca89 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:25:37.655571 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-4078eff9-b64c-47d0-8f59-4ca43d08ca89 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 204 len: 0 microversion: 2.1 time: 0.129855 Jul 07 07:25:37.656157 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 347/681] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:25:37 2022] DELETE /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:25:37.666533 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d87a6476-f432-401e-82ba-d0f00297557e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:37.667380 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d87a6476-f432-401e-82ba-d0f00297557e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:37.674206 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d87a6476-f432-401e-82ba-d0f00297557e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:37.674671 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d87a6476-f432-401e-82ba-d0f00297557e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:37.675446 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d87a6476-f432-401e-82ba-d0f00297557e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:37.675876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d87a6476-f432-401e-82ba-d0f00297557e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:37.810155 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d87a6476-f432-401e-82ba-d0f00297557e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:37.817990 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d87a6476-f432-401e-82ba-d0f00297557e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1690 microversion: 2.1 time: 0.156967 Jul 07 07:25:37.818545 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 335/682] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:37 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:38.188170 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-78a8faaf-ffe4-4ef9-bb78-5b43b45f2e23 req-fa413d63-f636-41c2-8302-3a430cb77b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d4c02-22a4-4c03-9cf1-9708f5de3922", "name": "network-vif-plugged", "status": "completed", "tag": "889f78e4-6681-40f3-bf13-bcf02b894624"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:38.196596 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5056c031-d52a-48ed-b356-5cde81c2f6f8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:38.197432 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5056c031-d52a-48ed-b356-5cde81c2f6f8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:38.198026 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-78a8faaf-ffe4-4ef9-bb78-5b43b45f2e23 req-fa413d63-f636-41c2-8302-3a430cb77b3c service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:38.198494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-78a8faaf-ffe4-4ef9-bb78-5b43b45f2e23 req-fa413d63-f636-41c2-8302-3a430cb77b3c service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:38.204724 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5056c031-d52a-48ed-b356-5cde81c2f6f8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:38.205179 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5056c031-d52a-48ed-b356-5cde81c2f6f8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:38.206001 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5056c031-d52a-48ed-b356-5cde81c2f6f8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:38.206435 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5056c031-d52a-48ed-b356-5cde81c2f6f8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:38.210473 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-78a8faaf-ffe4-4ef9-bb78-5b43b45f2e23 req-fa413d63-f636-41c2-8302-3a430cb77b3c service nova] Creating event network-vif-plugged:889f78e4-6681-40f3-bf13-bcf02b894624 for instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 on hv-cinder-82660 Jul 07 07:25:38.215835 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-78a8faaf-ffe4-4ef9-bb78-5b43b45f2e23 req-fa413d63-f636-41c2-8302-3a430cb77b3c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032371 Jul 07 07:25:38.216673 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 348/683] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:38.358070 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5056c031-d52a-48ed-b356-5cde81c2f6f8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:38.367911 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5056c031-d52a-48ed-b356-5cde81c2f6f8 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.175667 Jul 07 07:25:38.368505 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 336/684] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:38 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:25:38.832764 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:38.837115 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0ab878cb-1c9f-4d57-95c6-1b198cb31c01 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:38.837849 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0ab878cb-1c9f-4d57-95c6-1b198cb31c01 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:38.844973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ab878cb-1c9f-4d57-95c6-1b198cb31c01 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:38.845473 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ab878cb-1c9f-4d57-95c6-1b198cb31c01 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:38.846258 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ab878cb-1c9f-4d57-95c6-1b198cb31c01 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:38.846673 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0ab878cb-1c9f-4d57-95c6-1b198cb31c01 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:38.862158 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:38.986888 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0ab878cb-1c9f-4d57-95c6-1b198cb31c01 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:38.994998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0ab878cb-1c9f-4d57-95c6-1b198cb31c01 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1690 microversion: 2.1 time: 0.163148 Jul 07 07:25:38.995752 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 349/685] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:38 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:39.388372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-17c0ad35-269e-44f6-b8aa-75996a5d312e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:39.388990 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-17c0ad35-269e-44f6-b8aa-75996a5d312e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:39.391409 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:39.397098 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17c0ad35-269e-44f6-b8aa-75996a5d312e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:39.397696 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17c0ad35-269e-44f6-b8aa-75996a5d312e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:39.398497 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17c0ad35-269e-44f6-b8aa-75996a5d312e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:39.398911 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17c0ad35-269e-44f6-b8aa-75996a5d312e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:39.553154 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-17c0ad35-269e-44f6-b8aa-75996a5d312e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:39.561934 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-17c0ad35-269e-44f6-b8aa-75996a5d312e tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.177563 Jul 07 07:25:39.562544 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 337/686] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:39 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:40.013624 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1201fa3c-d10a-4bc7-a370-803cdcf0f620 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:40.014256 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1201fa3c-d10a-4bc7-a370-803cdcf0f620 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:40.021573 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1201fa3c-d10a-4bc7-a370-803cdcf0f620 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:40.022030 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1201fa3c-d10a-4bc7-a370-803cdcf0f620 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:40.022872 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1201fa3c-d10a-4bc7-a370-803cdcf0f620 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:40.023253 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1201fa3c-d10a-4bc7-a370-803cdcf0f620 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:40.167067 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1201fa3c-d10a-4bc7-a370-803cdcf0f620 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:40.174758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1201fa3c-d10a-4bc7-a370-803cdcf0f620 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1690 microversion: 2.1 time: 0.165333 Jul 07 07:25:40.175323 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 350/687] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:40 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:40.580247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-deb62167-0fb3-4b98-a5e2-f7e2f6de35db tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:40.580843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-deb62167-0fb3-4b98-a5e2-f7e2f6de35db tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:40.587873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-deb62167-0fb3-4b98-a5e2-f7e2f6de35db tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:40.588313 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-deb62167-0fb3-4b98-a5e2-f7e2f6de35db tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:40.589114 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-deb62167-0fb3-4b98-a5e2-f7e2f6de35db tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:40.590166 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-deb62167-0fb3-4b98-a5e2-f7e2f6de35db tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:40.741092 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-deb62167-0fb3-4b98-a5e2-f7e2f6de35db tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:40.754750 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-deb62167-0fb3-4b98-a5e2-f7e2f6de35db tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.177756 Jul 07 07:25:40.755636 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 338/688] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:40 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:41.192482 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-707df560-411c-4765-b893-7391dc882c0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:41.193115 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-707df560-411c-4765-b893-7391dc882c0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:41.201881 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-707df560-411c-4765-b893-7391dc882c0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:41.202572 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-707df560-411c-4765-b893-7391dc882c0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:41.203690 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-707df560-411c-4765-b893-7391dc882c0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:41.204331 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-707df560-411c-4765-b893-7391dc882c0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:41.350846 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-707df560-411c-4765-b893-7391dc882c0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:41.358992 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-707df560-411c-4765-b893-7391dc882c0a tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1690 microversion: 2.1 time: 0.170695 Jul 07 07:25:41.359569 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 351/689] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:41 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:41.774664 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-484f031b-e537-438e-b0d5-ea3b7ddcb125 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:41.775273 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-484f031b-e537-438e-b0d5-ea3b7ddcb125 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:41.782394 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-484f031b-e537-438e-b0d5-ea3b7ddcb125 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:41.782843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-484f031b-e537-438e-b0d5-ea3b7ddcb125 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:41.783620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-484f031b-e537-438e-b0d5-ea3b7ddcb125 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:41.784044 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-484f031b-e537-438e-b0d5-ea3b7ddcb125 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:41.919754 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-484f031b-e537-438e-b0d5-ea3b7ddcb125 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:41.927849 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-484f031b-e537-438e-b0d5-ea3b7ddcb125 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.157118 Jul 07 07:25:41.928582 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 339/690] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:41 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:42.377899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-03e00ef2-a216-43fa-887d-afb83c9012e2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:42.378518 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-03e00ef2-a216-43fa-887d-afb83c9012e2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:42.385410 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-03e00ef2-a216-43fa-887d-afb83c9012e2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:42.385410 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-03e00ef2-a216-43fa-887d-afb83c9012e2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:42.392565 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-03e00ef2-a216-43fa-887d-afb83c9012e2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:42.392565 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-03e00ef2-a216-43fa-887d-afb83c9012e2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:42.459459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-03e00ef2-a216-43fa-887d-afb83c9012e2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:42.467696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-03e00ef2-a216-43fa-887d-afb83c9012e2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1622 microversion: 2.1 time: 0.093753 Jul 07 07:25:42.468269 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 352/691] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:42 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1622 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:42.654620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-f8ce1298-cffd-43ae-9690-2b9ee5ca3489 req-cba70fa0-ff8e-47c9-a381-d1cd76358c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68b9418-cc4f-41da-8dba-1ef31555120e", "name": "network-vif-deleted", "tag": "2522ba46-c373-47c1-914e-51023019a66c"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:42.662980 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-f8ce1298-cffd-43ae-9690-2b9ee5ca3489 req-cba70fa0-ff8e-47c9-a381-d1cd76358c7f service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:42.663427 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-f8ce1298-cffd-43ae-9690-2b9ee5ca3489 req-cba70fa0-ff8e-47c9-a381-d1cd76358c7f service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:42.677628 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-f8ce1298-cffd-43ae-9690-2b9ee5ca3489 req-cba70fa0-ff8e-47c9-a381-d1cd76358c7f service nova] Creating event network-vif-deleted:2522ba46-c373-47c1-914e-51023019a66c for instance c68b9418-cc4f-41da-8dba-1ef31555120e on hv-cinder-82660 Jul 07 07:25:42.683221 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-f8ce1298-cffd-43ae-9690-2b9ee5ca3489 req-cba70fa0-ff8e-47c9-a381-d1cd76358c7f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033062 Jul 07 07:25:42.684518 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 340/692] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:42.946568 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8aa42df0-4ace-4e81-a0ed-5ddb63ab153c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:42.947189 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8aa42df0-4ace-4e81-a0ed-5ddb63ab153c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:42.955704 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8aa42df0-4ace-4e81-a0ed-5ddb63ab153c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:42.956415 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8aa42df0-4ace-4e81-a0ed-5ddb63ab153c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:42.957763 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8aa42df0-4ace-4e81-a0ed-5ddb63ab153c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:42.958443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8aa42df0-4ace-4e81-a0ed-5ddb63ab153c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:43.096333 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8aa42df0-4ace-4e81-a0ed-5ddb63ab153c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:43.104141 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8aa42df0-4ace-4e81-a0ed-5ddb63ab153c tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1367 microversion: 2.1 time: 0.161711 Jul 07 07:25:43.104740 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 353/693] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:42 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:43.493030 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:43.493846 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:43.501189 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:43.501671 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:43.502425 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:43.502851 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:43.537048 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:43.537510 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:43.537984 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lazy-loading 'fault' on Instance uuid c68b9418-cc4f-41da-8dba-1ef31555120e {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:25:43.582373 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:43.590787 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dd3f03a2-9801-4421-8689-eed26225356f tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 200 len: 1336 microversion: 2.1 time: 0.101857 Jul 07 07:25:43.591384 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 341/694] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:43 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:44.126360 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-38a7565b-bffb-4c13-8978-3da6e4714853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:44.127149 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-38a7565b-bffb-4c13-8978-3da6e4714853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:44.134496 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38a7565b-bffb-4c13-8978-3da6e4714853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:44.134941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38a7565b-bffb-4c13-8978-3da6e4714853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:44.135953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38a7565b-bffb-4c13-8978-3da6e4714853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:44.136922 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-38a7565b-bffb-4c13-8978-3da6e4714853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:44.277793 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-38a7565b-bffb-4c13-8978-3da6e4714853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:44.294000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-38a7565b-bffb-4c13-8978-3da6e4714853 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1557 microversion: 2.1 time: 0.172649 Jul 07 07:25:44.294602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 354/695] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:44 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:44.311516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4ac85048-af5e-49a0-a475-67a6f8d62286 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:44.312027 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4ac85048-af5e-49a0-a475-67a6f8d62286 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:44.318938 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ac85048-af5e-49a0-a475-67a6f8d62286 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:44.319389 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ac85048-af5e-49a0-a475-67a6f8d62286 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:44.320166 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ac85048-af5e-49a0-a475-67a6f8d62286 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:44.320602 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4ac85048-af5e-49a0-a475-67a6f8d62286 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:44.405255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4ac85048-af5e-49a0-a475-67a6f8d62286 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098144 Jul 07 07:25:44.405880 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 342/696] 10.222.0.62 () {58 vars in 1274 bytes} [Thu Jul 7 07:25:44 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:44.608268 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ba89328a-7cf5-4439-a0af-be83f6699a81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:44.608910 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ba89328a-7cf5-4439-a0af-be83f6699a81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: c68b9418-cc4f-41da-8dba-1ef31555120e] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:44.615775 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba89328a-7cf5-4439-a0af-be83f6699a81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:44.616235 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba89328a-7cf5-4439-a0af-be83f6699a81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:44.617019 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba89328a-7cf5-4439-a0af-be83f6699a81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:44.617505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba89328a-7cf5-4439-a0af-be83f6699a81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:44.632995 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-ba89328a-7cf5-4439-a0af-be83f6699a81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] HTTP exception thrown: Instance c68b9418-cc4f-41da-8dba-1ef31555120e could not be found. Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ba89328a-7cf5-4439-a0af-be83f6699a81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Request method failure captured: Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e HTTP/1.1 Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixomBgYKq99kztrIf-WXBT-oxXPLtswlcfUwVT_4CumoXbRkjjrZnfPLDoVDrFcuZtG6MmBwoFMiMVriYFP69L1sx8H6oqVwqo5FsA2CCk7qzym3IjG9WkQtWXfpG23zk0wtp5Enbd45xiS0O04WrCwexa1Gjm6jabSe4F855x7F4yTU Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 441079c8bc1b4a4fb8f38fff6728f3ef Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:25:44.634760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 441079c8bc1b4a4fb8f38fff6728f3ef Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-ServerRescueNegativeTestJSON-1796603694-project Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: b80ab2a9c7504806851400e07074004e Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796603694-project Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance c68b9418-cc4f-41da-8dba-1ef31555120e could not be found. Jul 07 07:25:44.636093 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': 'c68b9418-cc4f-41da-8dba-1ef31555120e'} Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68b9418-cc4f-41da-8dba-1ef31555120e could not be found. Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:25:44.636817 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68b9418-cc4f-41da-8dba-1ef31555120e could not be found. Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68b9418-cc4f-41da-8dba-1ef31555120e could not be found. Jul 07 07:25:44.638255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:25:44.639310 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ba89328a-7cf5-4439-a0af-be83f6699a81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Returning 404 to user: Instance c68b9418-cc4f-41da-8dba-1ef31555120e could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:25:44.639310 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ba89328a-7cf5-4439-a0af-be83f6699a81 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e" status: 404 len: 111 microversion: 2.1 time: 0.031981 Jul 07 07:25:44.639310 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 355/697] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:44 2022] GET /compute/v2.1/servers/c68b9418-cc4f-41da-8dba-1ef31555120e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:25:44.646020 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fc334e3a-a2c9-4e9a-aaba-22358d8f1574 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '.version_select at 0x7fccfa11e310>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:44.665722 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fc334e3a-a2c9-4e9a-aaba-22358d8f1574 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323280214" status: 202 len: 0 microversion: 2.1 time: 0.024192 Jul 07 07:25:44.666293 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 343/698] 10.222.0.62 () {58 vars in 1220 bytes} [Thu Jul 7 07:25:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1323280214 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:25:45.414167 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-b8582d2c-f34f-46c8-b84d-542d2c0b3a95 req-e95ed9ae-034d-4fcd-83af-023f566d9467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241d4c02-22a4-4c03-9cf1-9708f5de3922", "tag": "889f78e4-6681-40f3-bf13-bcf02b894624"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:45.423147 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b8582d2c-f34f-46c8-b84d-542d2c0b3a95 req-e95ed9ae-034d-4fcd-83af-023f566d9467 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:45.423712 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b8582d2c-f34f-46c8-b84d-542d2c0b3a95 req-e95ed9ae-034d-4fcd-83af-023f566d9467 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:45.435833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-b8582d2c-f34f-46c8-b84d-542d2c0b3a95 req-e95ed9ae-034d-4fcd-83af-023f566d9467 service nova] Creating event network-changed:889f78e4-6681-40f3-bf13-bcf02b894624 for instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 on hv-cinder-82660 Jul 07 07:25:45.441119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-b8582d2c-f34f-46c8-b84d-542d2c0b3a95 req-e95ed9ae-034d-4fcd-83af-023f566d9467 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031050 Jul 07 07:25:45.441947 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 356/699] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:47.581555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f58a6fc6-45c4-4c4e-bee5-22c82eee6297 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:47.582114 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f58a6fc6-45c4-4c4e-bee5-22c82eee6297 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:47.588384 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f58a6fc6-45c4-4c4e-bee5-22c82eee6297 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:47.588839 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f58a6fc6-45c4-4c4e-bee5-22c82eee6297 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:47.589650 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f58a6fc6-45c4-4c4e-bee5-22c82eee6297 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:47.590088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f58a6fc6-45c4-4c4e-bee5-22c82eee6297 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:47.616489 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f58a6fc6-45c4-4c4e-bee5-22c82eee6297 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:25:47.707768 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f58a6fc6-45c4-4c4e-bee5-22c82eee6297 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 204 len: 0 microversion: 2.1 time: 0.130556 Jul 07 07:25:47.708384 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 344/700] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:25:47 2022] DELETE /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:25:47.718303 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-adf4356d-f59a-41c2-a302-73ff2f62fb4d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:47.719010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-adf4356d-f59a-41c2-a302-73ff2f62fb4d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:47.725403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adf4356d-f59a-41c2-a302-73ff2f62fb4d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:47.725861 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adf4356d-f59a-41c2-a302-73ff2f62fb4d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:47.726650 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adf4356d-f59a-41c2-a302-73ff2f62fb4d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:47.727089 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-adf4356d-f59a-41c2-a302-73ff2f62fb4d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:47.873534 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-adf4356d-f59a-41c2-a302-73ff2f62fb4d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:47.881172 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-adf4356d-f59a-41c2-a302-73ff2f62fb4d tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1506 microversion: 2.1 time: 0.167885 Jul 07 07:25:47.881794 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 357/701] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:47 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:25:48.900861 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a538f1dd-3991-4c7a-985d-6ea3eec7dd7c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:48.901842 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a538f1dd-3991-4c7a-985d-6ea3eec7dd7c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:48.910402 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a538f1dd-3991-4c7a-985d-6ea3eec7dd7c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:48.910976 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a538f1dd-3991-4c7a-985d-6ea3eec7dd7c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:48.911960 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a538f1dd-3991-4c7a-985d-6ea3eec7dd7c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:48.912516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a538f1dd-3991-4c7a-985d-6ea3eec7dd7c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:49.058687 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a538f1dd-3991-4c7a-985d-6ea3eec7dd7c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:49.067274 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a538f1dd-3991-4c7a-985d-6ea3eec7dd7c tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1506 microversion: 2.1 time: 0.171847 Jul 07 07:25:49.067824 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 345/702] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:48 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:50.084899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-647c558e-15ff-4550-acdd-236e730cb7a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:50.085560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-647c558e-15ff-4550-acdd-236e730cb7a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:50.093255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-647c558e-15ff-4550-acdd-236e730cb7a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:50.093742 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-647c558e-15ff-4550-acdd-236e730cb7a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:50.094511 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-647c558e-15ff-4550-acdd-236e730cb7a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:50.094940 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-647c558e-15ff-4550-acdd-236e730cb7a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:50.099026 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:50.256431 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-647c558e-15ff-4550-acdd-236e730cb7a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:50.266398 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-647c558e-15ff-4550-acdd-236e730cb7a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1506 microversion: 2.1 time: 0.185472 Jul 07 07:25:50.266969 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 358/703] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:50 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:50.987400 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-2ca8c98a-34f0-45fd-b027-21bf04e828b4 req-a82dc39f-446a-4307-bc74-83b3e2c13603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d87467-2f1b-44d1-8284-ce40fe9f5c75", "name": "network-vif-deleted", "tag": "ad225bf5-677c-4aa5-85e9-6bd523bd389f"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:50.996020 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2ca8c98a-34f0-45fd-b027-21bf04e828b4 req-a82dc39f-446a-4307-bc74-83b3e2c13603 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:50.996470 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-2ca8c98a-34f0-45fd-b027-21bf04e828b4 req-a82dc39f-446a-4307-bc74-83b3e2c13603 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:51.008497 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-2ca8c98a-34f0-45fd-b027-21bf04e828b4 req-a82dc39f-446a-4307-bc74-83b3e2c13603 service nova] Creating event network-vif-deleted:ad225bf5-677c-4aa5-85e9-6bd523bd389f for instance a1d87467-2f1b-44d1-8284-ce40fe9f5c75 on hv-cinder-82660 Jul 07 07:25:51.016544 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-2ca8c98a-34f0-45fd-b027-21bf04e828b4 req-a82dc39f-446a-4307-bc74-83b3e2c13603 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103356 Jul 07 07:25:51.020530 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 346/704] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:51.289377 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:51.291061 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:51.293669 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:51.300085 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:51.300563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:51.301432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:51.301867 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:51.338801 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:51.339254 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:51.339704 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lazy-loading 'fault' on Instance uuid a1d87467-2f1b-44d1-8284-ce40fe9f5c75 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:25:51.383196 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:51.391362 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0d21c338-8faf-4b0b-947d-099495fa18fe tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 200 len: 1311 microversion: 2.1 time: 0.111310 Jul 07 07:25:51.391958 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 359/705] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:51 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:52.409516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eebb3451-da56-415a-922c-457f908a0969 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:52.410067 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eebb3451-da56-415a-922c-457f908a0969 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: a1d87467-2f1b-44d1-8284-ce40fe9f5c75] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:52.416964 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eebb3451-da56-415a-922c-457f908a0969 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:52.417483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eebb3451-da56-415a-922c-457f908a0969 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:52.418225 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eebb3451-da56-415a-922c-457f908a0969 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:52.418658 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eebb3451-da56-415a-922c-457f908a0969 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:52.432448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-eebb3451-da56-415a-922c-457f908a0969 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] HTTP exception thrown: Instance a1d87467-2f1b-44d1-8284-ce40fe9f5c75 could not be found. Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eebb3451-da56-415a-922c-457f908a0969 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Request method failure captured: Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 HTTP/1.1 Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixomBgYKq99kztrIf-WXBT-oxXPLtswlcfUwVT_4CumoXbRkjjrZnfPLDoVDrFcuZtG6MmBwoFMiMVriYFP69L1sx8H6oqVwqo5FsA2CCk7qzym3IjG9WkQtWXfpG23zk0wtp5Enbd45xiS0O04WrCwexa1Gjm6jabSe4F855x7F4yTU Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 441079c8bc1b4a4fb8f38fff6728f3ef Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:25:52.434478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 441079c8bc1b4a4fb8f38fff6728f3ef Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-ServerRescueNegativeTestJSON-1796603694-project Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: b80ab2a9c7504806851400e07074004e Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796603694-project Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance a1d87467-2f1b-44d1-8284-ce40fe9f5c75 could not be found. Jul 07 07:25:52.436093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'a1d87467-2f1b-44d1-8284-ce40fe9f5c75'} Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d87467-2f1b-44d1-8284-ce40fe9f5c75 could not be found. Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:25:52.436991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d87467-2f1b-44d1-8284-ce40fe9f5c75 could not be found. Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d87467-2f1b-44d1-8284-ce40fe9f5c75 could not be found. Jul 07 07:25:52.438488 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:52.440175 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eebb3451-da56-415a-922c-457f908a0969 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Returning 404 to user: Instance a1d87467-2f1b-44d1-8284-ce40fe9f5c75 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:25:52.440175 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eebb3451-da56-415a-922c-457f908a0969 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75" status: 404 len: 111 microversion: 2.1 time: 0.031374 Jul 07 07:25:52.440175 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 347/706] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:52 2022] GET /compute/v2.1/servers/a1d87467-2f1b-44d1-8284-ce40fe9f5c75 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:25:52.444618 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a9116cc1-2a80-4e5b-9934-44e3f8582fed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:52.445098 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a9116cc1-2a80-4e5b-9934-44e3f8582fed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:52.451896 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9116cc1-2a80-4e5b-9934-44e3f8582fed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:52.452352 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9116cc1-2a80-4e5b-9934-44e3f8582fed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:52.453282 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9116cc1-2a80-4e5b-9934-44e3f8582fed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:52.453752 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a9116cc1-2a80-4e5b-9934-44e3f8582fed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:52.481821 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a9116cc1-2a80-4e5b-9934-44e3f8582fed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:25:52.564972 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a9116cc1-2a80-4e5b-9934-44e3f8582fed tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 204 len: 0 microversion: 2.1 time: 0.123653 Jul 07 07:25:52.565871 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 360/707] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:25:52 2022] DELETE /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:25:52.576247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-150886af-0f8e-41b0-af5b-9cb1b1c35cbd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:52.576247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-150886af-0f8e-41b0-af5b-9cb1b1c35cbd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:52.582784 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-150886af-0f8e-41b0-af5b-9cb1b1c35cbd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:52.583225 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-150886af-0f8e-41b0-af5b-9cb1b1c35cbd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:52.583995 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-150886af-0f8e-41b0-af5b-9cb1b1c35cbd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:52.584463 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-150886af-0f8e-41b0-af5b-9cb1b1c35cbd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:52.733662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-150886af-0f8e-41b0-af5b-9cb1b1c35cbd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:52.741422 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-150886af-0f8e-41b0-af5b-9cb1b1c35cbd tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.170616 Jul 07 07:25:52.742052 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 348/708] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:52 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:53.762036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5cf91f07-4c68-41c1-a710-a989244363a2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:53.762694 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5cf91f07-4c68-41c1-a710-a989244363a2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:53.772984 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5cf91f07-4c68-41c1-a710-a989244363a2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:53.773694 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5cf91f07-4c68-41c1-a710-a989244363a2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:53.774787 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5cf91f07-4c68-41c1-a710-a989244363a2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:53.775406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5cf91f07-4c68-41c1-a710-a989244363a2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:53.933061 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5cf91f07-4c68-41c1-a710-a989244363a2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:53.944895 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5cf91f07-4c68-41c1-a710-a989244363a2 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.188796 Jul 07 07:25:53.945559 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 361/709] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:53 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:54.964308 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9c52038a-b663-4c64-8ce5-745506e7b43e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:54.964850 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9c52038a-b663-4c64-8ce5-745506e7b43e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:54.971833 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c52038a-b663-4c64-8ce5-745506e7b43e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:54.972269 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c52038a-b663-4c64-8ce5-745506e7b43e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:54.973023 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c52038a-b663-4c64-8ce5-745506e7b43e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:54.973479 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9c52038a-b663-4c64-8ce5-745506e7b43e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:55.116140 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9c52038a-b663-4c64-8ce5-745506e7b43e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:55.127637 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9c52038a-b663-4c64-8ce5-745506e7b43e tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.167356 Jul 07 07:25:55.128289 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 349/710] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:54 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:56.145629 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9b50e86f-34c5-4ebb-b1ab-5dfc649a71a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:56.146282 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9b50e86f-34c5-4ebb-b1ab-5dfc649a71a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:56.153268 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b50e86f-34c5-4ebb-b1ab-5dfc649a71a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:56.154118 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b50e86f-34c5-4ebb-b1ab-5dfc649a71a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:56.154485 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b50e86f-34c5-4ebb-b1ab-5dfc649a71a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:56.154914 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9b50e86f-34c5-4ebb-b1ab-5dfc649a71a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:56.299283 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9b50e86f-34c5-4ebb-b1ab-5dfc649a71a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:56.307321 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9b50e86f-34c5-4ebb-b1ab-5dfc649a71a7 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1522 microversion: 2.1 time: 0.166196 Jul 07 07:25:56.307976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 362/711] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:56 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:56.752177 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-f443d43f-d8b1-4c54-9aed-d14f5135af51 req-1c4208d1-324d-4bff-95ae-d3fbcdeba99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3f038b4-3e52-4a94-833f-708642a6fe10", "name": "network-vif-deleted", "tag": "892c6761-f95f-4d15-8cdf-6f04bacad94e"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:25:56.756876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:25:56.764266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-f443d43f-d8b1-4c54-9aed-d14f5135af51 req-1c4208d1-324d-4bff-95ae-d3fbcdeba99d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:56.764689 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-f443d43f-d8b1-4c54-9aed-d14f5135af51 req-1c4208d1-324d-4bff-95ae-d3fbcdeba99d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:56.778079 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-f443d43f-d8b1-4c54-9aed-d14f5135af51 req-1c4208d1-324d-4bff-95ae-d3fbcdeba99d service nova] Creating event network-vif-deleted:892c6761-f95f-4d15-8cdf-6f04bacad94e for instance f3f038b4-3e52-4a94-833f-708642a6fe10 on hv-cinder-82660 Jul 07 07:25:56.783818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-f443d43f-d8b1-4c54-9aed-d14f5135af51 req-1c4208d1-324d-4bff-95ae-d3fbcdeba99d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035377 Jul 07 07:25:56.784560 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 350/712] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:25:57.326581 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:57.327379 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:57.334531 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:57.334979 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:57.335766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:57.336207 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:57.370423 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:57.370916 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:57.371412 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lazy-loading 'fault' on Instance uuid f3f038b4-3e52-4a94-833f-708642a6fe10 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:25:57.418833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b80ab2a9c7504806851400e07074004e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '441079c8bc1b4a4fb8f38fff6728f3ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:25:57.426623 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-669b0460-645d-4117-80b7-dba385385a86 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 200 len: 1312 microversion: 2.1 time: 0.105168 Jul 07 07:25:57.427698 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 363/713] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:57 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:25:58.451373 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5da8e3f5-d367-4d40-82f7-2d015560fe12 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:25:58.452230 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5da8e3f5-d367-4d40-82f7-2d015560fe12 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] [instance: f3f038b4-3e52-4a94-833f-708642a6fe10] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:25:58.459799 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5da8e3f5-d367-4d40-82f7-2d015560fe12 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:58.460251 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5da8e3f5-d367-4d40-82f7-2d015560fe12 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:58.461025 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5da8e3f5-d367-4d40-82f7-2d015560fe12 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:25:58.461501 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5da8e3f5-d367-4d40-82f7-2d015560fe12 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:25:58.474955 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-5da8e3f5-d367-4d40-82f7-2d015560fe12 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] HTTP exception thrown: Instance f3f038b4-3e52-4a94-833f-708642a6fe10 could not be found. Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5da8e3f5-d367-4d40-82f7-2d015560fe12 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Request method failure captured: Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 HTTP/1.1 Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixomBgYKq99kztrIf-WXBT-oxXPLtswlcfUwVT_4CumoXbRkjjrZnfPLDoVDrFcuZtG6MmBwoFMiMVriYFP69L1sx8H6oqVwqo5FsA2CCk7qzym3IjG9WkQtWXfpG23zk0wtp5Enbd45xiS0O04WrCwexa1Gjm6jabSe4F855x7F4yTU Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 441079c8bc1b4a4fb8f38fff6728f3ef Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:25:58.476583 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/441079c8bc1b4a4fb8f38fff6728f3ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 441079c8bc1b4a4fb8f38fff6728f3ef Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796603694 Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-ServerRescueNegativeTestJSON-1796603694-project Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: b80ab2a9c7504806851400e07074004e Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796603694-project Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance f3f038b4-3e52-4a94-833f-708642a6fe10 could not be found. Jul 07 07:25:58.478080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'f3f038b4-3e52-4a94-833f-708642a6fe10'} Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3f038b4-3e52-4a94-833f-708642a6fe10 could not be found. Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:25:58.478889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3f038b4-3e52-4a94-833f-708642a6fe10 could not be found. Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3f038b4-3e52-4a94-833f-708642a6fe10 could not be found. Jul 07 07:25:58.480247 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:25:58.481595 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5da8e3f5-d367-4d40-82f7-2d015560fe12 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] Returning 404 to user: Instance f3f038b4-3e52-4a94-833f-708642a6fe10 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:25:58.481595 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5da8e3f5-d367-4d40-82f7-2d015560fe12 tempest-ServerRescueNegativeTestJSON-1796603694 tempest-ServerRescueNegativeTestJSON-1796603694-project] 10.222.0.62 "GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10" status: 404 len: 111 microversion: 2.1 time: 0.034760 Jul 07 07:25:58.481595 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 351/714] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:25:58 2022] GET /compute/v2.1/servers/f3f038b4-3e52-4a94-833f-708642a6fe10 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:26:01.592541 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b04e3057-c475-42a4-b5e6-6d01bd8feea8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:01.593078 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b04e3057-c475-42a4-b5e6-6d01bd8feea8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:01.599962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b04e3057-c475-42a4-b5e6-6d01bd8feea8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:01.600411 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b04e3057-c475-42a4-b5e6-6d01bd8feea8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:01.601346 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b04e3057-c475-42a4-b5e6-6d01bd8feea8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:01.601778 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b04e3057-c475-42a4-b5e6-6d01bd8feea8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:01.640568 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b04e3057-c475-42a4-b5e6-6d01bd8feea8 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/ips" status: 200 len: 147 microversion: 2.1 time: 0.121140 Jul 07 07:26:01.641525 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 364/715] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Jul 7 07:26:01 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/ips => generated 147 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:03.155257 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e9d5bf9a-3fe1-4380-84c6-0e34d79e4c8e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58fe723f-01ec-4466-992b-128b9fbb9d73"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:03.156343 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e9d5bf9a-3fe1-4380-84c6-0e34d79e4c8e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:03.163902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9d5bf9a-3fe1-4380-84c6-0e34d79e4c8e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:03.164573 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9d5bf9a-3fe1-4380-84c6-0e34d79e4c8e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:03.165387 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9d5bf9a-3fe1-4380-84c6-0e34d79e4c8e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:03.165843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e9d5bf9a-3fe1-4380-84c6-0e34d79e4c8e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:03.464925 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:03.494733 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e9d5bf9a-3fe1-4380-84c6-0e34d79e4c8e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342495 Jul 07 07:26:03.500534 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 352/716] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:26:03 2022] POST /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:26:05.015472 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-62b3e70f-0bc5-4477-a798-410be7b0931c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:05.016036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-62b3e70f-0bc5-4477-a798-410be7b0931c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:05.023335 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62b3e70f-0bc5-4477-a798-410be7b0931c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:05.023789 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62b3e70f-0bc5-4477-a798-410be7b0931c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:05.024578 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62b3e70f-0bc5-4477-a798-410be7b0931c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:05.026252 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-62b3e70f-0bc5-4477-a798-410be7b0931c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:05.053153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-62b3e70f-0bc5-4477-a798-410be7b0931c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/ips" status: 200 len: 152 microversion: 2.20 time: 0.289257 Jul 07 07:26:05.053996 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 365/717] 10.222.0.62 () {60 vars in 1288 bytes} [Thu Jul 7 07:26:04 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/ips => generated 152 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:26:06.899197 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-57797fda-733a-456f-ad7d-a16f39875402 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:06.899817 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-57797fda-733a-456f-ad7d-a16f39875402 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:06.906950 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57797fda-733a-456f-ad7d-a16f39875402 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:06.907400 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57797fda-733a-456f-ad7d-a16f39875402 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:06.908168 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57797fda-733a-456f-ad7d-a16f39875402 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:06.908714 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-57797fda-733a-456f-ad7d-a16f39875402 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:06.936326 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-57797fda-733a-456f-ad7d-a16f39875402 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lazy-loading 'flavor' on Instance uuid eb92117b-b521-46c1-bbef-7e97a808bab8 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:26:07.205473 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-57797fda-733a-456f-ad7d-a16f39875402 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "POST /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/action" status: 202 len: 0 microversion: 2.20 time: 0.310638 Jul 07 07:26:07.206137 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 353/718] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Jul 7 07:26:06 2022] POST /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:26:07.214970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3394b614-bfc0-4d68-9ee2-f88f69d5326b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:07.216321 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3394b614-bfc0-4d68-9ee2-f88f69d5326b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:07.223497 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3394b614-bfc0-4d68-9ee2-f88f69d5326b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:07.224342 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3394b614-bfc0-4d68-9ee2-f88f69d5326b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:07.225599 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3394b614-bfc0-4d68-9ee2-f88f69d5326b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:07.226450 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3394b614-bfc0-4d68-9ee2-f88f69d5326b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:07.363949 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3394b614-bfc0-4d68-9ee2-f88f69d5326b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:07.371877 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3394b614-bfc0-4d68-9ee2-f88f69d5326b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:07.373414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3394b614-bfc0-4d68-9ee2-f88f69d5326b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:07.374756 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3394b614-bfc0-4d68-9ee2-f88f69d5326b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.164178 Jul 07 07:26:07.375319 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 366/719] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:07 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:08.395315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-745115db-c660-41a5-87e3-bd736ba9dbe5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:08.395901 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-745115db-c660-41a5-87e3-bd736ba9dbe5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:08.402915 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-745115db-c660-41a5-87e3-bd736ba9dbe5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:08.403366 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-745115db-c660-41a5-87e3-bd736ba9dbe5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:08.404180 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-745115db-c660-41a5-87e3-bd736ba9dbe5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:08.404613 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-745115db-c660-41a5-87e3-bd736ba9dbe5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:08.551194 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-745115db-c660-41a5-87e3-bd736ba9dbe5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:08.560427 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-745115db-c660-41a5-87e3-bd736ba9dbe5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:08.561992 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-745115db-c660-41a5-87e3-bd736ba9dbe5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:08.563272 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-745115db-c660-41a5-87e3-bd736ba9dbe5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.173198 Jul 07 07:26:08.563866 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 354/720] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:08 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:09.582474 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7f4b3aeb-9cbc-49b4-bc6c-5e4dfbce715c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:09.583084 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7f4b3aeb-9cbc-49b4-bc6c-5e4dfbce715c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:09.590313 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f4b3aeb-9cbc-49b4-bc6c-5e4dfbce715c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:09.590765 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f4b3aeb-9cbc-49b4-bc6c-5e4dfbce715c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:09.591545 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f4b3aeb-9cbc-49b4-bc6c-5e4dfbce715c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:09.591982 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7f4b3aeb-9cbc-49b4-bc6c-5e4dfbce715c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:09.732456 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7f4b3aeb-9cbc-49b4-bc6c-5e4dfbce715c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:09.741468 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7f4b3aeb-9cbc-49b4-bc6c-5e4dfbce715c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:09.742981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7f4b3aeb-9cbc-49b4-bc6c-5e4dfbce715c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:09.744150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7f4b3aeb-9cbc-49b4-bc6c-5e4dfbce715c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.165741 Jul 07 07:26:09.744717 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 367/721] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:09 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:10.762765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f5b83876-14bd-4108-9a65-fe0a6dc4c7a4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:10.763307 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f5b83876-14bd-4108-9a65-fe0a6dc4c7a4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:10.770347 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5b83876-14bd-4108-9a65-fe0a6dc4c7a4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:10.770817 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5b83876-14bd-4108-9a65-fe0a6dc4c7a4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:10.771612 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5b83876-14bd-4108-9a65-fe0a6dc4c7a4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:10.772185 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f5b83876-14bd-4108-9a65-fe0a6dc4c7a4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:10.906699 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f5b83876-14bd-4108-9a65-fe0a6dc4c7a4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:10.914793 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f5b83876-14bd-4108-9a65-fe0a6dc4c7a4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:10.916304 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-f5b83876-14bd-4108-9a65-fe0a6dc4c7a4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:10.917494 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f5b83876-14bd-4108-9a65-fe0a6dc4c7a4 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.158780 Jul 07 07:26:10.918059 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 355/722] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:10 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:11.936414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aa42fe8c-679f-41e3-9c32-a0e34d17ef15 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:11.937310 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aa42fe8c-679f-41e3-9c32-a0e34d17ef15 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:11.944883 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa42fe8c-679f-41e3-9c32-a0e34d17ef15 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:11.945280 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa42fe8c-679f-41e3-9c32-a0e34d17ef15 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:11.946147 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa42fe8c-679f-41e3-9c32-a0e34d17ef15 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:11.946583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa42fe8c-679f-41e3-9c32-a0e34d17ef15 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:12.092827 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aa42fe8c-679f-41e3-9c32-a0e34d17ef15 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:12.101340 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aa42fe8c-679f-41e3-9c32-a0e34d17ef15 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:12.102909 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aa42fe8c-679f-41e3-9c32-a0e34d17ef15 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:12.104079 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aa42fe8c-679f-41e3-9c32-a0e34d17ef15 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.172044 Jul 07 07:26:12.104639 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 368/723] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:11 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:13.122609 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dfc6319f-28fa-4d5f-b9b5-f584cd7a73c3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:13.123226 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dfc6319f-28fa-4d5f-b9b5-f584cd7a73c3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:13.130255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dfc6319f-28fa-4d5f-b9b5-f584cd7a73c3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:13.130705 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dfc6319f-28fa-4d5f-b9b5-f584cd7a73c3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:13.131894 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dfc6319f-28fa-4d5f-b9b5-f584cd7a73c3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:13.132056 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dfc6319f-28fa-4d5f-b9b5-f584cd7a73c3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:13.208215 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d27dd9c9-9285-49f7-ad65-a15c37444bb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:13.209249 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d27dd9c9-9285-49f7-ad65-a15c37444bb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:13.216836 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d27dd9c9-9285-49f7-ad65-a15c37444bb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:13.217552 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d27dd9c9-9285-49f7-ad65-a15c37444bb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:13.218513 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d27dd9c9-9285-49f7-ad65-a15c37444bb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:13.218954 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d27dd9c9-9285-49f7-ad65-a15c37444bb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:13.259923 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d27dd9c9-9285-49f7-ad65-a15c37444bb6 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054663 Jul 07 07:26:13.260825 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 369/724] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:13 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:13.274367 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8d5863fd-daa2-4d8b-a069-022132360409 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:13.274868 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8d5863fd-daa2-4d8b-a069-022132360409 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:13.281290 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d5863fd-daa2-4d8b-a069-022132360409 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:13.281732 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d5863fd-daa2-4d8b-a069-022132360409 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:13.282514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d5863fd-daa2-4d8b-a069-022132360409 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:13.283080 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8d5863fd-daa2-4d8b-a069-022132360409 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:13.296040 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dfc6319f-28fa-4d5f-b9b5-f584cd7a73c3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:13.311541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dfc6319f-28fa-4d5f-b9b5-f584cd7a73c3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:13.313569 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dfc6319f-28fa-4d5f-b9b5-f584cd7a73c3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:13.314940 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dfc6319f-28fa-4d5f-b9b5-f584cd7a73c3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.196461 Jul 07 07:26:13.315625 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 356/725] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:13 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:13.324234 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8d5863fd-daa2-4d8b-a069-022132360409 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments/58fe723f-01ec-4466-992b-128b9fbb9d73" status: 200 len: 194 microversion: 2.1 time: 0.054361 Jul 07 07:26:13.325201 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 370/726] 10.222.0.62 () {58 vars in 1412 bytes} [Thu Jul 7 07:26:13 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments/58fe723f-01ec-4466-992b-128b9fbb9d73 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:13.531107 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-804e6762-e3f0-4757-8f3f-e98e0e17f866 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:13.531832 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-804e6762-e3f0-4757-8f3f-e98e0e17f866 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:13.538532 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-804e6762-e3f0-4757-8f3f-e98e0e17f866 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:13.539070 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-804e6762-e3f0-4757-8f3f-e98e0e17f866 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:13.540362 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-804e6762-e3f0-4757-8f3f-e98e0e17f866 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:13.541030 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-804e6762-e3f0-4757-8f3f-e98e0e17f866 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:13.567008 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-804e6762-e3f0-4757-8f3f-e98e0e17f866 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lazy-loading 'flavor' on Instance uuid 83944e7d-3750-4747-92ae-6a1f735c79fc {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:26:13.649513 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-804e6762-e3f0-4757-8f3f-e98e0e17f866 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "POST /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc/action" status: 202 len: 0 microversion: 2.1 time: 0.124290 Jul 07 07:26:13.650344 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 357/727] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:26:13 2022] POST /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 07:26:13.660601 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b9f47c26-7c4f-4700-8eb3-e6a6511f20ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:13.661937 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b9f47c26-7c4f-4700-8eb3-e6a6511f20ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:13.668838 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9f47c26-7c4f-4700-8eb3-e6a6511f20ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:13.670380 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9f47c26-7c4f-4700-8eb3-e6a6511f20ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:13.671602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9f47c26-7c4f-4700-8eb3-e6a6511f20ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:13.672106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9f47c26-7c4f-4700-8eb3-e6a6511f20ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:13.818502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b9f47c26-7c4f-4700-8eb3-e6a6511f20ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:13.828521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b9f47c26-7c4f-4700-8eb3-e6a6511f20ce tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.172715 Jul 07 07:26:13.829230 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 371/728] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:13 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:26:14.337244 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-63298818-0483-421e-b713-ad8317fa55d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:14.338143 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-63298818-0483-421e-b713-ad8317fa55d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:14.344654 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63298818-0483-421e-b713-ad8317fa55d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:14.345102 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63298818-0483-421e-b713-ad8317fa55d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:14.345909 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63298818-0483-421e-b713-ad8317fa55d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:14.346349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63298818-0483-421e-b713-ad8317fa55d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:14.486316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63298818-0483-421e-b713-ad8317fa55d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:14.499082 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63298818-0483-421e-b713-ad8317fa55d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:14.501321 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63298818-0483-421e-b713-ad8317fa55d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:14.502660 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-63298818-0483-421e-b713-ad8317fa55d2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.171084 Jul 07 07:26:14.503222 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 358/729] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:14 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:14.851237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ad08a575-4a7b-422d-9a31-66877c80ed1b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:14.851861 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ad08a575-4a7b-422d-9a31-66877c80ed1b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:14.862386 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad08a575-4a7b-422d-9a31-66877c80ed1b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:14.862838 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad08a575-4a7b-422d-9a31-66877c80ed1b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:14.863633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad08a575-4a7b-422d-9a31-66877c80ed1b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:14.864134 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ad08a575-4a7b-422d-9a31-66877c80ed1b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:15.007967 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ad08a575-4a7b-422d-9a31-66877c80ed1b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:15.016482 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ad08a575-4a7b-422d-9a31-66877c80ed1b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.171531 Jul 07 07:26:15.017198 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 372/730] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:14 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:15.521498 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a1d6eeb2-5dc0-4cd2-8007-9451e959f3a7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:15.522078 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a1d6eeb2-5dc0-4cd2-8007-9451e959f3a7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:15.529248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a1d6eeb2-5dc0-4cd2-8007-9451e959f3a7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:15.529715 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a1d6eeb2-5dc0-4cd2-8007-9451e959f3a7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:15.530532 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a1d6eeb2-5dc0-4cd2-8007-9451e959f3a7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:15.530969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a1d6eeb2-5dc0-4cd2-8007-9451e959f3a7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:15.684294 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a1d6eeb2-5dc0-4cd2-8007-9451e959f3a7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:15.692826 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a1d6eeb2-5dc0-4cd2-8007-9451e959f3a7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:15.694441 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a1d6eeb2-5dc0-4cd2-8007-9451e959f3a7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:15.695642 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a1d6eeb2-5dc0-4cd2-8007-9451e959f3a7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.178195 Jul 07 07:26:15.696195 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 359/731] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:15 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:26:16.035393 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7fdb8015-4f79-4580-ad3a-62830150aac0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:16.036004 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7fdb8015-4f79-4580-ad3a-62830150aac0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:16.043842 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7fdb8015-4f79-4580-ad3a-62830150aac0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:16.044284 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7fdb8015-4f79-4580-ad3a-62830150aac0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:16.045056 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7fdb8015-4f79-4580-ad3a-62830150aac0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:16.045506 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7fdb8015-4f79-4580-ad3a-62830150aac0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:16.049783 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:16.187812 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7fdb8015-4f79-4580-ad3a-62830150aac0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:16.195473 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7fdb8015-4f79-4580-ad3a-62830150aac0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.164345 Jul 07 07:26:16.196014 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 373/732] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:16 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:16.469515 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6ce08888-6462-49f0-9f8a-988eb241b37a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-510580042"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:16.470045 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6ce08888-6462-49f0-9f8a-988eb241b37a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:16.476718 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ce08888-6462-49f0-9f8a-988eb241b37a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:16.477156 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ce08888-6462-49f0-9f8a-988eb241b37a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:16.477967 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ce08888-6462-49f0-9f8a-988eb241b37a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:16.478388 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6ce08888-6462-49f0-9f8a-988eb241b37a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:16.613142 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.network.security_group_api [None req-6ce08888-6462-49f0-9f8a-988eb241b37a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Removing security group aa505b4d-5ad6-4038-b5b3-26084781bb0b from port 93dad3d5-bbb3-4950-91cc-7f4d0c71fe54 Jul 07 07:26:16.714060 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-878d28eb-82ae-42a8-9a19-d11ac60c908f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:16.714875 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-878d28eb-82ae-42a8-9a19-d11ac60c908f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:16.721953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-878d28eb-82ae-42a8-9a19-d11ac60c908f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:16.722569 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-878d28eb-82ae-42a8-9a19-d11ac60c908f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:16.723445 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-878d28eb-82ae-42a8-9a19-d11ac60c908f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:16.723944 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-878d28eb-82ae-42a8-9a19-d11ac60c908f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:16.945419 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-878d28eb-82ae-42a8-9a19-d11ac60c908f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:16.954380 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-878d28eb-82ae-42a8-9a19-d11ac60c908f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:16.956064 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-878d28eb-82ae-42a8-9a19-d11ac60c908f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:16.957272 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-878d28eb-82ae-42a8-9a19-d11ac60c908f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.247324 Jul 07 07:26:16.958041 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 374/733] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:16 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:26:16.963075 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-caf4b1ba-d407-4dcc-8a70-7994b6ea0a8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8a72c42-10e7-4b7b-b7cc-27d7224b329c"}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:16.964162 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-caf4b1ba-d407-4dcc-8a70-7994b6ea0a8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:16.970824 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-caf4b1ba-d407-4dcc-8a70-7994b6ea0a8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:16.971505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-caf4b1ba-d407-4dcc-8a70-7994b6ea0a8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:16.972467 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-caf4b1ba-d407-4dcc-8a70-7994b6ea0a8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:16.973058 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-caf4b1ba-d407-4dcc-8a70-7994b6ea0a8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:17.279765 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-caf4b1ba-d407-4dcc-8a70-7994b6ea0a8c tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "POST /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320325 Jul 07 07:26:17.285275 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 375/734] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:26:16 2022] POST /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:17.291130 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-48a8b46e-092d-4ecb-b8e2-ec0d6247fc78 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:17.291705 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-48a8b46e-092d-4ecb-b8e2-ec0d6247fc78 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:17.300706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48a8b46e-092d-4ecb-b8e2-ec0d6247fc78 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:17.301456 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48a8b46e-092d-4ecb-b8e2-ec0d6247fc78 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:17.302357 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48a8b46e-092d-4ecb-b8e2-ec0d6247fc78 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:17.302981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48a8b46e-092d-4ecb-b8e2-ec0d6247fc78 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:17.354484 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6ce08888-6462-49f0-9f8a-988eb241b37a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "POST /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/action" status: 202 len: 0 microversion: 2.1 time: 0.890291 Jul 07 07:26:17.355073 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 360/735] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:26:16 2022] POST /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:26:17.568076 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-48a8b46e-092d-4ecb-b8e2-ec0d6247fc78 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:17.576738 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-48a8b46e-092d-4ecb-b8e2-ec0d6247fc78 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.289945 Jul 07 07:26:17.586405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 376/736] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:17 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:17.646871 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-37e47ea0-bee5-496c-b275-4a912e9224c1 req-38617f17-ffd3-4dd9-ab19-92dd754b6a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e219f102-9056-42d4-86fd-4a0f8348d041", "tag": "93dad3d5-bbb3-4950-91cc-7f4d0c71fe54"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:17.665907 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-37e47ea0-bee5-496c-b275-4a912e9224c1 req-38617f17-ffd3-4dd9-ab19-92dd754b6a40 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:17.667997 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-37e47ea0-bee5-496c-b275-4a912e9224c1 req-38617f17-ffd3-4dd9-ab19-92dd754b6a40 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:17.717287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-37e47ea0-bee5-496c-b275-4a912e9224c1 req-38617f17-ffd3-4dd9-ab19-92dd754b6a40 service nova] Creating event network-changed:93dad3d5-bbb3-4950-91cc-7f4d0c71fe54 for instance e219f102-9056-42d4-86fd-4a0f8348d041 on hv-cinder-82660 Jul 07 07:26:17.748606 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-37e47ea0-bee5-496c-b275-4a912e9224c1 req-38617f17-ffd3-4dd9-ab19-92dd754b6a40 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.377699 Jul 07 07:26:17.750544 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 361/737] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:26:17.975579 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ee85d3f2-b439-4bb7-bace-8859cc31388f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:17.976140 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ee85d3f2-b439-4bb7-bace-8859cc31388f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:17.982918 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee85d3f2-b439-4bb7-bace-8859cc31388f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:17.983366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee85d3f2-b439-4bb7-bace-8859cc31388f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:17.984141 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee85d3f2-b439-4bb7-bace-8859cc31388f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:17.984604 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee85d3f2-b439-4bb7-bace-8859cc31388f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:18.182843 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee85d3f2-b439-4bb7-bace-8859cc31388f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:18.191880 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee85d3f2-b439-4bb7-bace-8859cc31388f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:18.193476 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee85d3f2-b439-4bb7-bace-8859cc31388f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:18.194661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ee85d3f2-b439-4bb7-bace-8859cc31388f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.223298 Jul 07 07:26:18.195237 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 377/738] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:17 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:18.595653 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e8fe7571-48e3-4dc0-93c2-c4c8caa80f7d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:18.596516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e8fe7571-48e3-4dc0-93c2-c4c8caa80f7d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:18.603500 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8fe7571-48e3-4dc0-93c2-c4c8caa80f7d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:18.603922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8fe7571-48e3-4dc0-93c2-c4c8caa80f7d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:18.604872 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8fe7571-48e3-4dc0-93c2-c4c8caa80f7d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:18.605633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e8fe7571-48e3-4dc0-93c2-c4c8caa80f7d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:18.756257 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ce81fb9d-732a-4b28-ac47-8383db69997c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:18.756823 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ce81fb9d-732a-4b28-ac47-8383db69997c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:18.782989 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e8fe7571-48e3-4dc0-93c2-c4c8caa80f7d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:18.785478 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce81fb9d-732a-4b28-ac47-8383db69997c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:18.785935 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce81fb9d-732a-4b28-ac47-8383db69997c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:18.786709 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce81fb9d-732a-4b28-ac47-8383db69997c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:18.787314 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce81fb9d-732a-4b28-ac47-8383db69997c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:18.811630 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e8fe7571-48e3-4dc0-93c2-c4c8caa80f7d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.220813 Jul 07 07:26:18.825297 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 362/739] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:18 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:18.885027 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-ce81fb9d-732a-4b28-ac47-8383db69997c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lazy-loading 'services' on Instance uuid e219f102-9056-42d4-86fd-4a0f8348d041 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:26:18.977405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ce81fb9d-732a-4b28-ac47-8383db69997c tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments/04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb" status: 202 len: 0 microversion: 2.1 time: 0.225234 Jul 07 07:26:18.978075 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 378/740] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:26:18 2022] DELETE /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments/04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:26:18.996162 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-520a3bd6-fbff-4e73-9cf7-c123a4986241 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:19.000912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-520a3bd6-fbff-4e73-9cf7-c123a4986241 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:19.010997 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-520a3bd6-fbff-4e73-9cf7-c123a4986241 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:19.011894 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-520a3bd6-fbff-4e73-9cf7-c123a4986241 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:19.012842 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-520a3bd6-fbff-4e73-9cf7-c123a4986241 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:19.013457 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-520a3bd6-fbff-4e73-9cf7-c123a4986241 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:19.051336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-520a3bd6-fbff-4e73-9cf7-c123a4986241 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064733 Jul 07 07:26:19.054349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 363/741] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:18 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:19.227358 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c991e6f0-9c56-409b-994d-ccf970836dff tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:19.228274 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c991e6f0-9c56-409b-994d-ccf970836dff tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:19.236083 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c991e6f0-9c56-409b-994d-ccf970836dff tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:19.236614 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c991e6f0-9c56-409b-994d-ccf970836dff tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:19.237651 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c991e6f0-9c56-409b-994d-ccf970836dff tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:19.238086 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c991e6f0-9c56-409b-994d-ccf970836dff tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:19.374676 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c991e6f0-9c56-409b-994d-ccf970836dff tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:19.383370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c991e6f0-9c56-409b-994d-ccf970836dff tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:19.384958 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c991e6f0-9c56-409b-994d-ccf970836dff tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:19.386164 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c991e6f0-9c56-409b-994d-ccf970836dff tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.176358 Jul 07 07:26:19.386777 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 379/742] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:19 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:19.788535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-df8e8aec-fa5f-458e-8bd2-4a03a997e180 req-8759b603-8295-4236-a254-da661db7b8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e219f102-9056-42d4-86fd-4a0f8348d041", "tag": "93dad3d5-bbb3-4950-91cc-7f4d0c71fe54"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:19.798120 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-df8e8aec-fa5f-458e-8bd2-4a03a997e180 req-8759b603-8295-4236-a254-da661db7b8dc service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:19.798570 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-df8e8aec-fa5f-458e-8bd2-4a03a997e180 req-8759b603-8295-4236-a254-da661db7b8dc service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:19.811074 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-df8e8aec-fa5f-458e-8bd2-4a03a997e180 req-8759b603-8295-4236-a254-da661db7b8dc service nova] Creating event network-changed:93dad3d5-bbb3-4950-91cc-7f4d0c71fe54 for instance e219f102-9056-42d4-86fd-4a0f8348d041 on hv-cinder-82660 Jul 07 07:26:19.816222 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-df8e8aec-fa5f-458e-8bd2-4a03a997e180 req-8759b603-8295-4236-a254-da661db7b8dc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031452 Jul 07 07:26:19.816996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 364/743] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:19.832038 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ba57ac24-1088-4d0d-9dff-501c123f5585 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:19.832667 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ba57ac24-1088-4d0d-9dff-501c123f5585 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:19.839708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba57ac24-1088-4d0d-9dff-501c123f5585 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:19.840174 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba57ac24-1088-4d0d-9dff-501c123f5585 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:19.840959 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba57ac24-1088-4d0d-9dff-501c123f5585 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:19.841448 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ba57ac24-1088-4d0d-9dff-501c123f5585 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:19.985797 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ba57ac24-1088-4d0d-9dff-501c123f5585 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:19.996798 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ba57ac24-1088-4d0d-9dff-501c123f5585 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.168348 Jul 07 07:26:19.997682 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 380/744] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:19 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:20.068586 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c6502d5b-9eeb-41b5-8dd1-d2cc01b1b9e3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:20.070146 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c6502d5b-9eeb-41b5-8dd1-d2cc01b1b9e3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:20.079694 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6502d5b-9eeb-41b5-8dd1-d2cc01b1b9e3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:20.080260 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6502d5b-9eeb-41b5-8dd1-d2cc01b1b9e3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:20.081277 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6502d5b-9eeb-41b5-8dd1-d2cc01b1b9e3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:20.081739 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c6502d5b-9eeb-41b5-8dd1-d2cc01b1b9e3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:20.112021 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c6502d5b-9eeb-41b5-8dd1-d2cc01b1b9e3 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050189 Jul 07 07:26:20.112782 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 365/745] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:20 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:20.405528 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-54324a8f-cef0-4b01-80da-4b1823ada530 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:20.406044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-54324a8f-cef0-4b01-80da-4b1823ada530 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:20.412869 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54324a8f-cef0-4b01-80da-4b1823ada530 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:20.413331 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54324a8f-cef0-4b01-80da-4b1823ada530 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:20.414124 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54324a8f-cef0-4b01-80da-4b1823ada530 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:20.414540 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54324a8f-cef0-4b01-80da-4b1823ada530 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:20.565656 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-54324a8f-cef0-4b01-80da-4b1823ada530 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:20.574863 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-54324a8f-cef0-4b01-80da-4b1823ada530 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:20.576373 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-54324a8f-cef0-4b01-80da-4b1823ada530 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:20.577563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-54324a8f-cef0-4b01-80da-4b1823ada530 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.176110 Jul 07 07:26:20.578110 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 381/746] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:20 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:21.019067 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b4f0124c-a314-445d-8bae-ca107fb2b377 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:21.019646 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b4f0124c-a314-445d-8bae-ca107fb2b377 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:21.026625 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4f0124c-a314-445d-8bae-ca107fb2b377 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:21.027078 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4f0124c-a314-445d-8bae-ca107fb2b377 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:21.027847 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4f0124c-a314-445d-8bae-ca107fb2b377 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:21.028283 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4f0124c-a314-445d-8bae-ca107fb2b377 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:21.046973 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=92,nova_cell1:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:21.124154 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f0b417e4-8b3d-4911-9245-2ff83cab8d87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:21.125465 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f0b417e4-8b3d-4911-9245-2ff83cab8d87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:21.132758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f0b417e4-8b3d-4911-9245-2ff83cab8d87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:21.133340 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f0b417e4-8b3d-4911-9245-2ff83cab8d87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:21.134203 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f0b417e4-8b3d-4911-9245-2ff83cab8d87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:21.134722 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f0b417e4-8b3d-4911-9245-2ff83cab8d87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:21.171720 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b4f0124c-a314-445d-8bae-ca107fb2b377 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:21.171875 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f0b417e4-8b3d-4911-9245-2ff83cab8d87 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051521 Jul 07 07:26:21.172492 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 382/747] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:21 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:21.182034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b4f0124c-a314-445d-8bae-ca107fb2b377 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.169070 Jul 07 07:26:21.182601 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 366/748] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:21 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:21.603363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0470e105-ab7f-4ae0-b132-1ec236e1d9b1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:21.605025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0470e105-ab7f-4ae0-b132-1ec236e1d9b1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:21.609011 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:21.616662 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0470e105-ab7f-4ae0-b132-1ec236e1d9b1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:21.617127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0470e105-ab7f-4ae0-b132-1ec236e1d9b1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:21.617954 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0470e105-ab7f-4ae0-b132-1ec236e1d9b1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:21.618416 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0470e105-ab7f-4ae0-b132-1ec236e1d9b1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:21.765172 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0470e105-ab7f-4ae0-b132-1ec236e1d9b1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:21.775815 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0470e105-ab7f-4ae0-b132-1ec236e1d9b1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:21.777436 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-0470e105-ab7f-4ae0-b132-1ec236e1d9b1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:21.778631 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0470e105-ab7f-4ae0-b132-1ec236e1d9b1 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.185631 Jul 07 07:26:21.779167 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 383/749] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:21 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:22.184475 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-59e977ce-43ca-43ff-a499-983659cdebb4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:22.185464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-59e977ce-43ca-43ff-a499-983659cdebb4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:22.192472 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59e977ce-43ca-43ff-a499-983659cdebb4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:22.192924 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59e977ce-43ca-43ff-a499-983659cdebb4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:22.193717 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59e977ce-43ca-43ff-a499-983659cdebb4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:22.194203 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-59e977ce-43ca-43ff-a499-983659cdebb4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:22.200005 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-43c66077-f96b-4d42-8f65-47824842bc2c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:22.200642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-43c66077-f96b-4d42-8f65-47824842bc2c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:22.207667 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43c66077-f96b-4d42-8f65-47824842bc2c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:22.208110 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43c66077-f96b-4d42-8f65-47824842bc2c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:22.208869 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43c66077-f96b-4d42-8f65-47824842bc2c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:22.209331 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-43c66077-f96b-4d42-8f65-47824842bc2c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:22.223469 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-59e977ce-43ca-43ff-a499-983659cdebb4 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Jul 07 07:26:22.224061 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 367/750] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:22 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:22.346661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-43c66077-f96b-4d42-8f65-47824842bc2c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:22.354460 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-43c66077-f96b-4d42-8f65-47824842bc2c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.158238 Jul 07 07:26:22.355009 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 384/751] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:22 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:22.796473 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-28f3100e-f0c5-40f9-83ec-fa543d9d9585 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:22.797435 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-28f3100e-f0c5-40f9-83ec-fa543d9d9585 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:22.804480 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28f3100e-f0c5-40f9-83ec-fa543d9d9585 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:22.804931 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28f3100e-f0c5-40f9-83ec-fa543d9d9585 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:22.805754 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28f3100e-f0c5-40f9-83ec-fa543d9d9585 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:22.806184 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-28f3100e-f0c5-40f9-83ec-fa543d9d9585 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:22.940691 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28f3100e-f0c5-40f9-83ec-fa543d9d9585 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:22.948990 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28f3100e-f0c5-40f9-83ec-fa543d9d9585 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:22.950569 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-28f3100e-f0c5-40f9-83ec-fa543d9d9585 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:22.951740 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-28f3100e-f0c5-40f9-83ec-fa543d9d9585 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.159410 Jul 07 07:26:22.952319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 368/752] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:22 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:23.235791 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-018263cc-8f56-4e02-af11-ff8623ba6379 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:23.236776 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-018263cc-8f56-4e02-af11-ff8623ba6379 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:23.243731 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-018263cc-8f56-4e02-af11-ff8623ba6379 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:23.244235 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-018263cc-8f56-4e02-af11-ff8623ba6379 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:23.245010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-018263cc-8f56-4e02-af11-ff8623ba6379 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:23.245477 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-018263cc-8f56-4e02-af11-ff8623ba6379 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:23.276235 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-018263cc-8f56-4e02-af11-ff8623ba6379 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Jul 07 07:26:23.276832 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 385/753] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:23 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:23.371331 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4fa8ddfe-47e5-4831-ab99-d2d3b908a4bb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:23.372063 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4fa8ddfe-47e5-4831-ab99-d2d3b908a4bb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:23.379472 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fa8ddfe-47e5-4831-ab99-d2d3b908a4bb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:23.379780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fa8ddfe-47e5-4831-ab99-d2d3b908a4bb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:23.380555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fa8ddfe-47e5-4831-ab99-d2d3b908a4bb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:23.380996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fa8ddfe-47e5-4831-ab99-d2d3b908a4bb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:23.517813 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4fa8ddfe-47e5-4831-ab99-d2d3b908a4bb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:23.529275 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4fa8ddfe-47e5-4831-ab99-d2d3b908a4bb tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.161838 Jul 07 07:26:23.529819 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 369/754] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:23 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:23.973959 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1ec6850c-699a-47a3-b1c2-9adcc95dd660 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:23.974570 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1ec6850c-699a-47a3-b1c2-9adcc95dd660 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:23.984080 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec6850c-699a-47a3-b1c2-9adcc95dd660 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:23.984674 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec6850c-699a-47a3-b1c2-9adcc95dd660 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:23.985899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec6850c-699a-47a3-b1c2-9adcc95dd660 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:23.986495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ec6850c-699a-47a3-b1c2-9adcc95dd660 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:24.127469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1ec6850c-699a-47a3-b1c2-9adcc95dd660 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:24.137976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1ec6850c-699a-47a3-b1c2-9adcc95dd660 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:24.139516 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1ec6850c-699a-47a3-b1c2-9adcc95dd660 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:24.140702 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1ec6850c-699a-47a3-b1c2-9adcc95dd660 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.173181 Jul 07 07:26:24.141299 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 386/755] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:23 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:24.290511 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c31ffa2a-e3ab-4f38-89ed-8b3b9442cc8b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:24.291596 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c31ffa2a-e3ab-4f38-89ed-8b3b9442cc8b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:24.297864 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c31ffa2a-e3ab-4f38-89ed-8b3b9442cc8b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:24.298316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c31ffa2a-e3ab-4f38-89ed-8b3b9442cc8b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:24.299096 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c31ffa2a-e3ab-4f38-89ed-8b3b9442cc8b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:24.299531 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c31ffa2a-e3ab-4f38-89ed-8b3b9442cc8b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:24.333360 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c31ffa2a-e3ab-4f38-89ed-8b3b9442cc8b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048550 Jul 07 07:26:24.334765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 370/756] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:24 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:24.546931 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fc4b97dc-be56-4560-a0ff-34e34a777d3b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:24.547651 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fc4b97dc-be56-4560-a0ff-34e34a777d3b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:24.554813 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fc4b97dc-be56-4560-a0ff-34e34a777d3b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:24.555087 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fc4b97dc-be56-4560-a0ff-34e34a777d3b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:24.555913 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fc4b97dc-be56-4560-a0ff-34e34a777d3b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:24.556351 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fc4b97dc-be56-4560-a0ff-34e34a777d3b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:24.698317 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fc4b97dc-be56-4560-a0ff-34e34a777d3b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:24.702005 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:24.707096 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fc4b97dc-be56-4560-a0ff-34e34a777d3b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.164201 Jul 07 07:26:24.707696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 387/757] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:24 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:25.159960 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4e6970f4-269b-48b3-a204-38b4ad45c838 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:25.160600 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4e6970f4-269b-48b3-a204-38b4ad45c838 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:25.170467 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e6970f4-269b-48b3-a204-38b4ad45c838 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:25.171146 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e6970f4-269b-48b3-a204-38b4ad45c838 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:25.172374 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e6970f4-269b-48b3-a204-38b4ad45c838 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:25.173089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4e6970f4-269b-48b3-a204-38b4ad45c838 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:25.306354 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4e6970f4-269b-48b3-a204-38b4ad45c838 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:25.315476 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4e6970f4-269b-48b3-a204-38b4ad45c838 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:25.316969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4e6970f4-269b-48b3-a204-38b4ad45c838 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:25.318182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4e6970f4-269b-48b3-a204-38b4ad45c838 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.163333 Jul 07 07:26:25.318751 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 371/758] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:25 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:25.348040 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-add729f6-0852-4522-a083-c00e1617938a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:25.348997 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-add729f6-0852-4522-a083-c00e1617938a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:25.356427 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-add729f6-0852-4522-a083-c00e1617938a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:25.356894 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-add729f6-0852-4522-a083-c00e1617938a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:25.357686 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-add729f6-0852-4522-a083-c00e1617938a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:25.358121 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-add729f6-0852-4522-a083-c00e1617938a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:25.387728 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-add729f6-0852-4522-a083-c00e1617938a tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Jul 07 07:26:25.388285 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 388/759] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:25 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:25.724490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-eb2afc3e-023e-446b-b675-c4f464db656a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:25.725113 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-eb2afc3e-023e-446b-b675-c4f464db656a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:25.731781 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb2afc3e-023e-446b-b675-c4f464db656a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:25.732233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb2afc3e-023e-446b-b675-c4f464db656a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:25.733059 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb2afc3e-023e-446b-b675-c4f464db656a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:25.733529 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-eb2afc3e-023e-446b-b675-c4f464db656a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:25.882999 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-eb2afc3e-023e-446b-b675-c4f464db656a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:25.891013 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-eb2afc3e-023e-446b-b675-c4f464db656a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.170466 Jul 07 07:26:25.891813 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 372/760] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:25 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:26.343105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1ed94c70-41df-445e-b669-ecf2b812889a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:26.343787 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1ed94c70-41df-445e-b669-ecf2b812889a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:26.350757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ed94c70-41df-445e-b669-ecf2b812889a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:26.351234 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ed94c70-41df-445e-b669-ecf2b812889a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:26.352078 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ed94c70-41df-445e-b669-ecf2b812889a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:26.352563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1ed94c70-41df-445e-b669-ecf2b812889a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:26.402530 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3fd5e6d1-bfed-4cdc-aabe-c2278ae7eb95 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:26.403517 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3fd5e6d1-bfed-4cdc-aabe-c2278ae7eb95 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:26.410533 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3fd5e6d1-bfed-4cdc-aabe-c2278ae7eb95 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:26.410985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3fd5e6d1-bfed-4cdc-aabe-c2278ae7eb95 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:26.411758 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3fd5e6d1-bfed-4cdc-aabe-c2278ae7eb95 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:26.412190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3fd5e6d1-bfed-4cdc-aabe-c2278ae7eb95 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:26.443424 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3fd5e6d1-bfed-4cdc-aabe-c2278ae7eb95 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046452 Jul 07 07:26:26.444024 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 373/761] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:26 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:26:26.488986 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1ed94c70-41df-445e-b669-ecf2b812889a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:26.497099 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1ed94c70-41df-445e-b669-ecf2b812889a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:26.498637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1ed94c70-41df-445e-b669-ecf2b812889a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:26.499834 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1ed94c70-41df-445e-b669-ecf2b812889a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.161477 Jul 07 07:26:26.500393 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 389/762] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:26 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:26.908065 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3360f668-0c54-4df2-b245-6c2c00b2f95b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:26.908681 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3360f668-0c54-4df2-b245-6c2c00b2f95b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:26.910676 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=48 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:26.916393 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3360f668-0c54-4df2-b245-6c2c00b2f95b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:26.916861 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3360f668-0c54-4df2-b245-6c2c00b2f95b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:26.917661 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3360f668-0c54-4df2-b245-6c2c00b2f95b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:26.918100 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3360f668-0c54-4df2-b245-6c2c00b2f95b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:26.973534 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9fc3840a-c3b0-4f52-bfa5-3c61be199972 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:26.974605 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9fc3840a-c3b0-4f52-bfa5-3c61be199972 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:26.981108 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9fc3840a-c3b0-4f52-bfa5-3c61be199972 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:26.981717 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9fc3840a-c3b0-4f52-bfa5-3c61be199972 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:26.982468 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9fc3840a-c3b0-4f52-bfa5-3c61be199972 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:26.982903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9fc3840a-c3b0-4f52-bfa5-3c61be199972 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:27.014062 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9fc3840a-c3b0-4f52-bfa5-3c61be199972 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044567 Jul 07 07:26:27.014900 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 390/763] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:26 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:27.059785 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3360f668-0c54-4df2-b245-6c2c00b2f95b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:27.067754 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3360f668-0c54-4df2-b245-6c2c00b2f95b tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.163595 Jul 07 07:26:27.068316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 374/764] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:26 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:27.164145 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-59f9de6c-02b0-46ed-8666-de7cbec11481 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:27.164629 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-59f9de6c-02b0-46ed-8666-de7cbec11481 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:27.171282 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59f9de6c-02b0-46ed-8666-de7cbec11481 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:27.171726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59f9de6c-02b0-46ed-8666-de7cbec11481 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:27.172540 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59f9de6c-02b0-46ed-8666-de7cbec11481 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:27.172969 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-59f9de6c-02b0-46ed-8666-de7cbec11481 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:27.204072 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-59f9de6c-02b0-46ed-8666-de7cbec11481 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments/58fe723f-01ec-4466-992b-128b9fbb9d73" status: 200 len: 194 microversion: 2.1 time: 0.044106 Jul 07 07:26:27.204644 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 391/765] 10.222.0.62 () {58 vars in 1412 bytes} [Thu Jul 7 07:26:27 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments/58fe723f-01ec-4466-992b-128b9fbb9d73 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:27.214900 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f21eb321-4788-4c63-b6f7-a453c3567daa tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:27.215322 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f21eb321-4788-4c63-b6f7-a453c3567daa tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:27.221979 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f21eb321-4788-4c63-b6f7-a453c3567daa tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:27.222431 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f21eb321-4788-4c63-b6f7-a453c3567daa tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:27.223216 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f21eb321-4788-4c63-b6f7-a453c3567daa tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:27.223674 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f21eb321-4788-4c63-b6f7-a453c3567daa tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:27.310182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-f21eb321-4788-4c63-b6f7-a453c3567daa tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lazy-loading 'services' on Instance uuid 14904778-9fa1-42ab-9f55-44a650b96877 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:26:27.399358 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f21eb321-4788-4c63-b6f7-a453c3567daa tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "DELETE /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments/58fe723f-01ec-4466-992b-128b9fbb9d73" status: 202 len: 0 microversion: 2.1 time: 0.188061 Jul 07 07:26:27.400142 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 375/766] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:26:27 2022] DELETE /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments/58fe723f-01ec-4466-992b-128b9fbb9d73 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:26:27.460182 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c3093e9c-70d5-44fa-bc91-79e0c4646b60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:27.461410 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c3093e9c-70d5-44fa-bc91-79e0c4646b60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:27.469015 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3093e9c-70d5-44fa-bc91-79e0c4646b60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:27.469436 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3093e9c-70d5-44fa-bc91-79e0c4646b60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:27.470214 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3093e9c-70d5-44fa-bc91-79e0c4646b60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:27.470645 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c3093e9c-70d5-44fa-bc91-79e0c4646b60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:27.500834 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c3093e9c-70d5-44fa-bc91-79e0c4646b60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047763 Jul 07 07:26:27.501412 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 392/767] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:27 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:26:27.519414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1edaf03a-8813-4c51-b75c-ffcf27df8bc3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:27.520117 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1edaf03a-8813-4c51-b75c-ffcf27df8bc3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:27.527238 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1edaf03a-8813-4c51-b75c-ffcf27df8bc3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:27.527696 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1edaf03a-8813-4c51-b75c-ffcf27df8bc3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:27.528479 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1edaf03a-8813-4c51-b75c-ffcf27df8bc3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:27.528914 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1edaf03a-8813-4c51-b75c-ffcf27df8bc3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:27.676378 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1edaf03a-8813-4c51-b75c-ffcf27df8bc3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:27.685185 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1edaf03a-8813-4c51-b75c-ffcf27df8bc3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:27.686698 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1edaf03a-8813-4c51-b75c-ffcf27df8bc3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:27.687896 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1edaf03a-8813-4c51-b75c-ffcf27df8bc3 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.173321 Jul 07 07:26:27.688525 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 376/768] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:27 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:28.085682 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-050e5ddf-0083-4cef-9904-e4a319a2f97a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:28.086312 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-050e5ddf-0083-4cef-9904-e4a319a2f97a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:28.092933 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-050e5ddf-0083-4cef-9904-e4a319a2f97a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:28.093414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-050e5ddf-0083-4cef-9904-e4a319a2f97a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:28.094186 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-050e5ddf-0083-4cef-9904-e4a319a2f97a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:28.094604 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-050e5ddf-0083-4cef-9904-e4a319a2f97a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:28.228970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-050e5ddf-0083-4cef-9904-e4a319a2f97a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:28.239552 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-050e5ddf-0083-4cef-9904-e4a319a2f97a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.157717 Jul 07 07:26:28.240422 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 393/769] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:28 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:28.522827 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4c7dac13-7bd3-4a1c-8f88-b0f863117026 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:28.523936 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4c7dac13-7bd3-4a1c-8f88-b0f863117026 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:28.533553 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c7dac13-7bd3-4a1c-8f88-b0f863117026 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:28.534167 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c7dac13-7bd3-4a1c-8f88-b0f863117026 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:28.535065 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c7dac13-7bd3-4a1c-8f88-b0f863117026 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:28.535710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4c7dac13-7bd3-4a1c-8f88-b0f863117026 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:28.569298 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4c7dac13-7bd3-4a1c-8f88-b0f863117026 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050397 Jul 07 07:26:28.569864 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 377/770] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:28 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:28.706284 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-12446bd9-34c1-4be9-a006-c322acd334a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:28.706913 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-12446bd9-34c1-4be9-a006-c322acd334a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:28.714241 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-12446bd9-34c1-4be9-a006-c322acd334a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:28.714797 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-12446bd9-34c1-4be9-a006-c322acd334a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:28.715706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-12446bd9-34c1-4be9-a006-c322acd334a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:28.716209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-12446bd9-34c1-4be9-a006-c322acd334a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:28.915929 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-12446bd9-34c1-4be9-a006-c322acd334a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:28.926168 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-12446bd9-34c1-4be9-a006-c322acd334a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:28.928259 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-12446bd9-34c1-4be9-a006-c322acd334a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:28.929706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-12446bd9-34c1-4be9-a006-c322acd334a5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1745 microversion: 2.20 time: 0.227375 Jul 07 07:26:28.930400 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 394/771] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:28 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1745 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:29.258549 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b18ea4c0-8a34-4ba9-87b3-1f4a818794bd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:29.259169 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b18ea4c0-8a34-4ba9-87b3-1f4a818794bd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:29.266248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b18ea4c0-8a34-4ba9-87b3-1f4a818794bd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:29.266708 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b18ea4c0-8a34-4ba9-87b3-1f4a818794bd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:29.267486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b18ea4c0-8a34-4ba9-87b3-1f4a818794bd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:29.267923 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b18ea4c0-8a34-4ba9-87b3-1f4a818794bd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:29.412415 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b18ea4c0-8a34-4ba9-87b3-1f4a818794bd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:29.420720 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b18ea4c0-8a34-4ba9-87b3-1f4a818794bd tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.166806 Jul 07 07:26:29.421328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 378/772] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:29 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:29.582366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d29e5298-c814-42d2-b66c-f9a1f0bcb38e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:29.583458 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d29e5298-c814-42d2-b66c-f9a1f0bcb38e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:29.589859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d29e5298-c814-42d2-b66c-f9a1f0bcb38e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:29.590314 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d29e5298-c814-42d2-b66c-f9a1f0bcb38e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:29.591095 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d29e5298-c814-42d2-b66c-f9a1f0bcb38e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:29.591708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d29e5298-c814-42d2-b66c-f9a1f0bcb38e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:29.622075 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d29e5298-c814-42d2-b66c-f9a1f0bcb38e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043948 Jul 07 07:26:29.622850 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 395/773] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:29 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 07:26:29.633480 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-686dec82-0723-4c11-9527-a13351d44500 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:29.634048 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-686dec82-0723-4c11-9527-a13351d44500 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:29.640736 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-686dec82-0723-4c11-9527-a13351d44500 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:29.641182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-686dec82-0723-4c11-9527-a13351d44500 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:29.642005 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-686dec82-0723-4c11-9527-a13351d44500 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:29.642438 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-686dec82-0723-4c11-9527-a13351d44500 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:29.721780 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-686dec82-0723-4c11-9527-a13351d44500 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] HTTP exception thrown: Instance e219f102-9056-42d4-86fd-4a0f8348d041 is not attached to volume 04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-686dec82-0723-4c11-9527-a13351d44500 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Request method failure captured: Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments/04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb HTTP/1.1 Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixonpjWyZb1HjsRceHt944lVumI-EVDivnIo-PPCtVsC1Lze2wSWGZS0dnubHPZKzQOkKRk5aNJxoBs1ZXNaB6s5t8iWQtOFQ2OaxNKNF7s20NzipT4jijAj09GEBuPpBapethIVNDIDKOjGMZX-8JPf1Ms2-Ql2UPw7Ke1uZm03DP48 Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: e976a7167fc84b0ca11b4d0d1effcff3 Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestMinimumBasicScenario-1797266766 Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:26:29.724231 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e976a7167fc84b0ca11b4d0d1effcff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e976a7167fc84b0ca11b4d0d1effcff3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e976a7167fc84b0ca11b4d0d1effcff3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e976a7167fc84b0ca11b4d0d1effcff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestMinimumBasicScenario-1797266766 Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: e976a7167fc84b0ca11b4d0d1effcff3 Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1797266766 Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-TestMinimumBasicScenario-1797266766-project Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: cee7676762a04042a599439058ba90ad Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestMinimumBasicScenario-1797266766-project Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:26:29.725792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance e219f102-9056-42d4-86fd-4a0f8348d041 is not attached to volume 04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'server_id': 'e219f102-9056-42d4-86fd-4a0f8348d041', 'id': '04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb'} Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb. Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:26:29.726652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e219f102-9056-42d4-86fd-4a0f8348d041 is not attached to volume 04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e219f102-9056-42d4-86fd-4a0f8348d041 is not attached to volume 04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:29.728034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-686dec82-0723-4c11-9527-a13351d44500 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Returning 404 to user: Instance e219f102-9056-42d4-86fd-4a0f8348d041 is not attached to volume 04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:26:29.729167 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-686dec82-0723-4c11-9527-a13351d44500 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments/04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb" status: 404 len: 154 microversion: 2.1 time: 0.097005 Jul 07 07:26:29.729167 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 379/774] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:26:29 2022] DELETE /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041/os-volume_attachments/04aae72f-9e9c-4e12-bab8-cf6ee3aef6eb => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:26:29.950513 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dcfce52a-8246-490b-b93c-b14c175c9341 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:29.951089 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dcfce52a-8246-490b-b93c-b14c175c9341 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:29.959567 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dcfce52a-8246-490b-b93c-b14c175c9341 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:29.960101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dcfce52a-8246-490b-b93c-b14c175c9341 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:29.961088 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dcfce52a-8246-490b-b93c-b14c175c9341 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:29.961690 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dcfce52a-8246-490b-b93c-b14c175c9341 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:30.117669 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dcfce52a-8246-490b-b93c-b14c175c9341 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:30.130867 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dcfce52a-8246-490b-b93c-b14c175c9341 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:30.132915 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dcfce52a-8246-490b-b93c-b14c175c9341 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:30.134508 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dcfce52a-8246-490b-b93c-b14c175c9341 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1745 microversion: 2.20 time: 0.188661 Jul 07 07:26:30.135224 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 396/775] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:29 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:30.438893 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-35bf39c0-5be2-4af1-87e1-dafd099b8b27 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:30.439531 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-35bf39c0-5be2-4af1-87e1-dafd099b8b27 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:30.446181 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35bf39c0-5be2-4af1-87e1-dafd099b8b27 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:30.446843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35bf39c0-5be2-4af1-87e1-dafd099b8b27 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:30.447619 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35bf39c0-5be2-4af1-87e1-dafd099b8b27 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:30.448053 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35bf39c0-5be2-4af1-87e1-dafd099b8b27 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:30.583675 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-35bf39c0-5be2-4af1-87e1-dafd099b8b27 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:30.591741 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-35bf39c0-5be2-4af1-87e1-dafd099b8b27 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.157249 Jul 07 07:26:30.592340 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 380/776] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:30 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:30.630011 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2d171d7e-7ca2-468e-9561-2aa88468c121 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:30.630510 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2d171d7e-7ca2-468e-9561-2aa88468c121 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:30.636769 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d171d7e-7ca2-468e-9561-2aa88468c121 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:30.637261 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d171d7e-7ca2-468e-9561-2aa88468c121 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:30.638033 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d171d7e-7ca2-468e-9561-2aa88468c121 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:30.638459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2d171d7e-7ca2-468e-9561-2aa88468c121 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:30.667726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2d171d7e-7ca2-468e-9561-2aa88468c121 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments/d8a72c42-10e7-4b7b-b7cc-27d7224b329c" status: 200 len: 194 microversion: 2.1 time: 0.041682 Jul 07 07:26:30.668320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 397/777] 10.222.0.62 () {58 vars in 1412 bytes} [Thu Jul 7 07:26:30 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments/d8a72c42-10e7-4b7b-b7cc-27d7224b329c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:30.680452 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6e482904-9528-495f-a34f-fd23d966d66b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:30.680994 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6e482904-9528-495f-a34f-fd23d966d66b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:30.691760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e482904-9528-495f-a34f-fd23d966d66b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:30.692365 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e482904-9528-495f-a34f-fd23d966d66b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:30.693732 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e482904-9528-495f-a34f-fd23d966d66b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:30.694342 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6e482904-9528-495f-a34f-fd23d966d66b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:30.777112 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-6e482904-9528-495f-a34f-fd23d966d66b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lazy-loading 'services' on Instance uuid 14904778-9fa1-42ab-9f55-44a650b96877 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:26:30.846274 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:30.858943 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6e482904-9528-495f-a34f-fd23d966d66b tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "DELETE /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments/d8a72c42-10e7-4b7b-b7cc-27d7224b329c" status: 202 len: 0 microversion: 2.1 time: 0.184118 Jul 07 07:26:30.859728 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 381/778] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:26:30 2022] DELETE /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments/d8a72c42-10e7-4b7b-b7cc-27d7224b329c => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:26:30.868692 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-51eb92a0-4834-4c76-8bda-da3277a4d9b7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:30.869389 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-51eb92a0-4834-4c76-8bda-da3277a4d9b7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:30.876161 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-51eb92a0-4834-4c76-8bda-da3277a4d9b7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:30.876825 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-51eb92a0-4834-4c76-8bda-da3277a4d9b7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:30.877743 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-51eb92a0-4834-4c76-8bda-da3277a4d9b7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:30.878300 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-51eb92a0-4834-4c76-8bda-da3277a4d9b7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:30.903927 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-51eb92a0-4834-4c76-8bda-da3277a4d9b7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:26:30.998260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-51eb92a0-4834-4c76-8bda-da3277a4d9b7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 204 len: 0 microversion: 2.1 time: 0.133776 Jul 07 07:26:30.998956 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 398/779] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:26:30 2022] DELETE /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:26:31.009521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-17c5d466-c001-43c0-ad41-1ab60de4e6d7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:31.010358 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-17c5d466-c001-43c0-ad41-1ab60de4e6d7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:31.016668 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17c5d466-c001-43c0-ad41-1ab60de4e6d7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:31.017117 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17c5d466-c001-43c0-ad41-1ab60de4e6d7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:31.017907 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17c5d466-c001-43c0-ad41-1ab60de4e6d7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:31.018339 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-17c5d466-c001-43c0-ad41-1ab60de4e6d7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:31.154310 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1a2192ce-56bc-46e3-bb6a-d62a349de073 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:31.154942 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1a2192ce-56bc-46e3-bb6a-d62a349de073 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:31.161558 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a2192ce-56bc-46e3-bb6a-d62a349de073 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:31.162045 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a2192ce-56bc-46e3-bb6a-d62a349de073 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:31.164795 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a2192ce-56bc-46e3-bb6a-d62a349de073 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:31.165251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1a2192ce-56bc-46e3-bb6a-d62a349de073 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:31.165423 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-17c5d466-c001-43c0-ad41-1ab60de4e6d7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:31.173165 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-17c5d466-c001-43c0-ad41-1ab60de4e6d7 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1553 microversion: 2.1 time: 0.168074 Jul 07 07:26:31.173762 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 382/780] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:31 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:31.321601 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1a2192ce-56bc-46e3-bb6a-d62a349de073 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:31.330660 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1a2192ce-56bc-46e3-bb6a-d62a349de073 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:31.332153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1a2192ce-56bc-46e3-bb6a-d62a349de073 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:31.333470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1a2192ce-56bc-46e3-bb6a-d62a349de073 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1745 microversion: 2.20 time: 0.183836 Jul 07 07:26:31.334083 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 399/781] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:31 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:31.610083 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-af1e94f1-cec7-40e3-afac-110608fcae14 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:31.610682 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-af1e94f1-cec7-40e3-afac-110608fcae14 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:31.617695 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af1e94f1-cec7-40e3-afac-110608fcae14 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:31.618134 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af1e94f1-cec7-40e3-afac-110608fcae14 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:31.618893 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af1e94f1-cec7-40e3-afac-110608fcae14 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:31.619324 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-af1e94f1-cec7-40e3-afac-110608fcae14 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:31.768466 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-af1e94f1-cec7-40e3-afac-110608fcae14 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:31.780251 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-af1e94f1-cec7-40e3-afac-110608fcae14 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.174014 Jul 07 07:26:31.780971 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 383/782] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:31 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:32.194260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b9665a77-50fe-444b-9444-a4a958315e60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:32.195394 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b9665a77-50fe-444b-9444-a4a958315e60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:32.203919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9665a77-50fe-444b-9444-a4a958315e60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:32.204370 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9665a77-50fe-444b-9444-a4a958315e60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:32.205145 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9665a77-50fe-444b-9444-a4a958315e60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:32.205637 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9665a77-50fe-444b-9444-a4a958315e60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:32.354106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b9665a77-50fe-444b-9444-a4a958315e60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:32.354345 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d32d85aa-184f-4cf6-a8c0-8177deb51b39 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:32.355200 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d32d85aa-184f-4cf6-a8c0-8177deb51b39 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:32.361660 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d32d85aa-184f-4cf6-a8c0-8177deb51b39 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:32.362022 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b9665a77-50fe-444b-9444-a4a958315e60 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1553 microversion: 2.1 time: 0.173950 Jul 07 07:26:32.362168 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d32d85aa-184f-4cf6-a8c0-8177deb51b39 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:32.362557 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 400/783] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:32 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:32.362844 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d32d85aa-184f-4cf6-a8c0-8177deb51b39 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:32.363523 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d32d85aa-184f-4cf6-a8c0-8177deb51b39 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:32.496541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d32d85aa-184f-4cf6-a8c0-8177deb51b39 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:32.508836 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d32d85aa-184f-4cf6-a8c0-8177deb51b39 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:32.511320 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d32d85aa-184f-4cf6-a8c0-8177deb51b39 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:32.513440 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d32d85aa-184f-4cf6-a8c0-8177deb51b39 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1745 microversion: 2.20 time: 0.163134 Jul 07 07:26:32.514012 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 384/784] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:32 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:32.797941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b35e440f-19f1-4c7e-aab1-d6db0c0e0767 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:32.798560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b35e440f-19f1-4c7e-aab1-d6db0c0e0767 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:32.807016 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b35e440f-19f1-4c7e-aab1-d6db0c0e0767 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:32.807691 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b35e440f-19f1-4c7e-aab1-d6db0c0e0767 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:32.809103 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b35e440f-19f1-4c7e-aab1-d6db0c0e0767 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:32.809680 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b35e440f-19f1-4c7e-aab1-d6db0c0e0767 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:32.956665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b35e440f-19f1-4c7e-aab1-d6db0c0e0767 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:32.964395 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b35e440f-19f1-4c7e-aab1-d6db0c0e0767 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.170442 Jul 07 07:26:32.964971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 401/785] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:32 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:33.379111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2e5f64ce-77e9-4855-bb7f-9ed22b625779 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:33.379715 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2e5f64ce-77e9-4855-bb7f-9ed22b625779 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:33.386690 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2e5f64ce-77e9-4855-bb7f-9ed22b625779 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:33.387134 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2e5f64ce-77e9-4855-bb7f-9ed22b625779 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:33.388052 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2e5f64ce-77e9-4855-bb7f-9ed22b625779 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:33.388849 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2e5f64ce-77e9-4855-bb7f-9ed22b625779 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:33.525478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2e5f64ce-77e9-4855-bb7f-9ed22b625779 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:33.531787 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-692ebf91-9fc3-4d59-9e65-4abd65592893 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:33.532466 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-692ebf91-9fc3-4d59-9e65-4abd65592893 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:33.533614 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2e5f64ce-77e9-4855-bb7f-9ed22b625779 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1553 microversion: 2.1 time: 0.158309 Jul 07 07:26:33.534205 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 385/786] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:33 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:33.539771 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-692ebf91-9fc3-4d59-9e65-4abd65592893 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:33.540282 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-692ebf91-9fc3-4d59-9e65-4abd65592893 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:33.541165 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-692ebf91-9fc3-4d59-9e65-4abd65592893 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:33.541760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-692ebf91-9fc3-4d59-9e65-4abd65592893 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:33.684117 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-692ebf91-9fc3-4d59-9e65-4abd65592893 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:33.687614 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:33.692918 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-692ebf91-9fc3-4d59-9e65-4abd65592893 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:33.694441 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-692ebf91-9fc3-4d59-9e65-4abd65592893 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:33.695589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-692ebf91-9fc3-4d59-9e65-4abd65592893 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1745 microversion: 2.20 time: 0.167898 Jul 07 07:26:33.696147 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 402/787] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:33 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:33.981609 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ac3ac73e-dd5a-49c5-88b7-66e95e28e05e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:33.982224 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ac3ac73e-dd5a-49c5-88b7-66e95e28e05e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:33.989136 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac3ac73e-dd5a-49c5-88b7-66e95e28e05e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:33.989620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac3ac73e-dd5a-49c5-88b7-66e95e28e05e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:33.990400 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac3ac73e-dd5a-49c5-88b7-66e95e28e05e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:33.990874 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ac3ac73e-dd5a-49c5-88b7-66e95e28e05e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:34.144075 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ac3ac73e-dd5a-49c5-88b7-66e95e28e05e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:34.154950 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ac3ac73e-dd5a-49c5-88b7-66e95e28e05e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.177262 Jul 07 07:26:34.155394 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 386/788] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:33 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:34.551485 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9635a02b-c8ec-4aa5-bae6-aa738bf540cd tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:34.552113 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9635a02b-c8ec-4aa5-bae6-aa738bf540cd tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:34.559974 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9635a02b-c8ec-4aa5-bae6-aa738bf540cd tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:34.560415 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9635a02b-c8ec-4aa5-bae6-aa738bf540cd tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:34.561413 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9635a02b-c8ec-4aa5-bae6-aa738bf540cd tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:34.561643 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9635a02b-c8ec-4aa5-bae6-aa738bf540cd tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:34.694235 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9635a02b-c8ec-4aa5-bae6-aa738bf540cd tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:34.704613 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9635a02b-c8ec-4aa5-bae6-aa738bf540cd tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1553 microversion: 2.1 time: 0.157502 Jul 07 07:26:34.705325 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 403/789] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:34 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:34.715345 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fdc84884-eb65-49be-ac94-d601e38ef036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:34.715962 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fdc84884-eb65-49be-ac94-d601e38ef036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:34.722736 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdc84884-eb65-49be-ac94-d601e38ef036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:34.723245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdc84884-eb65-49be-ac94-d601e38ef036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:34.724002 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdc84884-eb65-49be-ac94-d601e38ef036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:34.724433 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fdc84884-eb65-49be-ac94-d601e38ef036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:34.882955 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fdc84884-eb65-49be-ac94-d601e38ef036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:34.891150 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fdc84884-eb65-49be-ac94-d601e38ef036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:34.892651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fdc84884-eb65-49be-ac94-d601e38ef036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:34.893847 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fdc84884-eb65-49be-ac94-d601e38ef036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1745 microversion: 2.20 time: 0.182368 Jul 07 07:26:34.894431 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 387/790] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:34 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:35.178200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9beba67e-8321-40f6-b25d-e03776f00b03 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:35.178816 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9beba67e-8321-40f6-b25d-e03776f00b03 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:35.185703 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9beba67e-8321-40f6-b25d-e03776f00b03 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:35.186156 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9beba67e-8321-40f6-b25d-e03776f00b03 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:35.187005 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9beba67e-8321-40f6-b25d-e03776f00b03 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:35.187447 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9beba67e-8321-40f6-b25d-e03776f00b03 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:35.323562 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9beba67e-8321-40f6-b25d-e03776f00b03 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:35.331902 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9beba67e-8321-40f6-b25d-e03776f00b03 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.157565 Jul 07 07:26:35.332494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 404/791] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:35 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:35.721659 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e425b92c-6143-4f8e-8c94-ace488f51299 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:35.722274 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e425b92c-6143-4f8e-8c94-ace488f51299 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:35.728822 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e425b92c-6143-4f8e-8c94-ace488f51299 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:35.729297 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e425b92c-6143-4f8e-8c94-ace488f51299 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:35.730065 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e425b92c-6143-4f8e-8c94-ace488f51299 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:35.730503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e425b92c-6143-4f8e-8c94-ace488f51299 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:35.867255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e425b92c-6143-4f8e-8c94-ace488f51299 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:35.875600 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e425b92c-6143-4f8e-8c94-ace488f51299 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1553 microversion: 2.1 time: 0.157801 Jul 07 07:26:35.876176 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 388/792] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:35 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:35.912151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-05dbc055-a0e0-4a4d-a85a-be4b4495b960 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:35.912792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-05dbc055-a0e0-4a4d-a85a-be4b4495b960 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:35.919794 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05dbc055-a0e0-4a4d-a85a-be4b4495b960 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:35.920271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05dbc055-a0e0-4a4d-a85a-be4b4495b960 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:35.921073 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05dbc055-a0e0-4a4d-a85a-be4b4495b960 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:35.921567 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-05dbc055-a0e0-4a4d-a85a-be4b4495b960 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:36.062410 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05dbc055-a0e0-4a4d-a85a-be4b4495b960 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:36.070410 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05dbc055-a0e0-4a4d-a85a-be4b4495b960 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:36.071924 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-05dbc055-a0e0-4a4d-a85a-be4b4495b960 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:36.073144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-05dbc055-a0e0-4a4d-a85a-be4b4495b960 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1745 microversion: 2.20 time: 0.165082 Jul 07 07:26:36.073780 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 405/793] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:35 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:36.271327 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-daec45c9-d575-44b9-be22-d3863b4c921b req-995cbdc1-ba2b-48b5-86b0-3c53cbcb2966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb92117b-b521-46c1-bbef-7e97a808bab8", "name": "network-vif-plugged", "status": "completed", "tag": "304ba8c6-1b84-41a1-aaca-b548534ce32b"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:36.281319 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-daec45c9-d575-44b9-be22-d3863b4c921b req-995cbdc1-ba2b-48b5-86b0-3c53cbcb2966 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:36.281748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-daec45c9-d575-44b9-be22-d3863b4c921b req-995cbdc1-ba2b-48b5-86b0-3c53cbcb2966 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:36.294464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-daec45c9-d575-44b9-be22-d3863b4c921b req-995cbdc1-ba2b-48b5-86b0-3c53cbcb2966 service nova] Creating event network-vif-plugged:304ba8c6-1b84-41a1-aaca-b548534ce32b for instance eb92117b-b521-46c1-bbef-7e97a808bab8 on hv-cinder-82660 Jul 07 07:26:36.299792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-daec45c9-d575-44b9-be22-d3863b4c921b req-995cbdc1-ba2b-48b5-86b0-3c53cbcb2966 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091924 Jul 07 07:26:36.300657 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 389/794] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:36.350585 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-55b3f4b9-85cd-4e51-9abf-bc45cfdc9a85 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:36.351332 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-55b3f4b9-85cd-4e51-9abf-bc45cfdc9a85 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:36.358094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55b3f4b9-85cd-4e51-9abf-bc45cfdc9a85 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:36.358554 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55b3f4b9-85cd-4e51-9abf-bc45cfdc9a85 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:36.359361 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55b3f4b9-85cd-4e51-9abf-bc45cfdc9a85 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:36.359796 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-55b3f4b9-85cd-4e51-9abf-bc45cfdc9a85 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:36.509941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-55b3f4b9-85cd-4e51-9abf-bc45cfdc9a85 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:36.517933 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-55b3f4b9-85cd-4e51-9abf-bc45cfdc9a85 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.171410 Jul 07 07:26:36.518508 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 406/795] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:36 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:36.893928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3a64bfa4-e5f5-4fab-a877-9f44d4ca3386 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:36.894657 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3a64bfa4-e5f5-4fab-a877-9f44d4ca3386 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:36.901932 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a64bfa4-e5f5-4fab-a877-9f44d4ca3386 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:36.902280 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a64bfa4-e5f5-4fab-a877-9f44d4ca3386 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:36.903102 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a64bfa4-e5f5-4fab-a877-9f44d4ca3386 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:36.903843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3a64bfa4-e5f5-4fab-a877-9f44d4ca3386 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:37.092533 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b9b90412-fa46-4b18-8ab5-e6107f199c8d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:37.093302 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b9b90412-fa46-4b18-8ab5-e6107f199c8d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:37.102753 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3a64bfa4-e5f5-4fab-a877-9f44d4ca3386 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:37.110678 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3a64bfa4-e5f5-4fab-a877-9f44d4ca3386 tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1553 microversion: 2.1 time: 0.221553 Jul 07 07:26:37.120577 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9b90412-fa46-4b18-8ab5-e6107f199c8d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:37.120577 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9b90412-fa46-4b18-8ab5-e6107f199c8d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:37.120577 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9b90412-fa46-4b18-8ab5-e6107f199c8d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:37.120577 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b9b90412-fa46-4b18-8ab5-e6107f199c8d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:37.121916 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 390/796] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:36 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:37.336123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b9b90412-fa46-4b18-8ab5-e6107f199c8d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:37.344954 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b9b90412-fa46-4b18-8ab5-e6107f199c8d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:37.347049 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b9b90412-fa46-4b18-8ab5-e6107f199c8d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:37.349240 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b9b90412-fa46-4b18-8ab5-e6107f199c8d tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.261244 Jul 07 07:26:37.350625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 407/797] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:37 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:37.366457 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-a67b24be-b362-4409-a027-08aefe560a46 req-04a6b5da-8c00-47dd-8028-2ef2391fb058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e219f102-9056-42d4-86fd-4a0f8348d041", "name": "network-vif-deleted", "tag": "93dad3d5-bbb3-4950-91cc-7f4d0c71fe54"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:37.378555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a67b24be-b362-4409-a027-08aefe560a46 req-04a6b5da-8c00-47dd-8028-2ef2391fb058 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:37.378996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-a67b24be-b362-4409-a027-08aefe560a46 req-04a6b5da-8c00-47dd-8028-2ef2391fb058 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:37.390760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-a67b24be-b362-4409-a027-08aefe560a46 req-04a6b5da-8c00-47dd-8028-2ef2391fb058 service nova] Creating event network-vif-deleted:93dad3d5-bbb3-4950-91cc-7f4d0c71fe54 for instance e219f102-9056-42d4-86fd-4a0f8348d041 on hv-cinder-82660 Jul 07 07:26:37.396042 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-a67b24be-b362-4409-a027-08aefe560a46 req-04a6b5da-8c00-47dd-8028-2ef2391fb058 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033778 Jul 07 07:26:37.397062 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 391/798] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:26:37.536552 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8c75af4a-ded1-479e-8aaa-c6b7959ec1dc tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:37.537423 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8c75af4a-ded1-479e-8aaa-c6b7959ec1dc tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:37.546709 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c75af4a-ded1-479e-8aaa-c6b7959ec1dc tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:37.547166 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c75af4a-ded1-479e-8aaa-c6b7959ec1dc tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:37.548084 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c75af4a-ded1-479e-8aaa-c6b7959ec1dc tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:37.548572 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c75af4a-ded1-479e-8aaa-c6b7959ec1dc tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:37.749538 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8c75af4a-ded1-479e-8aaa-c6b7959ec1dc tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:37.765271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8c75af4a-ded1-479e-8aaa-c6b7959ec1dc tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1566 microversion: 2.1 time: 0.234708 Jul 07 07:26:37.778422 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 408/799] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:37 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:37.786413 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c4adbe3c-157a-46da-aaac-dafd5f29a887 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:37.787593 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c4adbe3c-157a-46da-aaac-dafd5f29a887 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:37.797817 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4adbe3c-157a-46da-aaac-dafd5f29a887 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:37.798420 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4adbe3c-157a-46da-aaac-dafd5f29a887 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:37.799233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4adbe3c-157a-46da-aaac-dafd5f29a887 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:37.799653 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c4adbe3c-157a-46da-aaac-dafd5f29a887 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:37.898227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c4adbe3c-157a-46da-aaac-dafd5f29a887 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "POST /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc/action" status: 202 len: 0 microversion: 2.1 time: 0.118330 Jul 07 07:26:37.899711 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 392/800] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Jul 7 07:26:37 2022] POST /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 07 07:26:37.915672 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c645dd52-ff70-49f4-bdcf-c27e65dab83d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:37.916396 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c645dd52-ff70-49f4-bdcf-c27e65dab83d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:37.925965 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c645dd52-ff70-49f4-bdcf-c27e65dab83d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:37.926587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c645dd52-ff70-49f4-bdcf-c27e65dab83d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:37.927494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c645dd52-ff70-49f4-bdcf-c27e65dab83d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:37.928047 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c645dd52-ff70-49f4-bdcf-c27e65dab83d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:38.097624 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c645dd52-ff70-49f4-bdcf-c27e65dab83d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:38.107940 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c645dd52-ff70-49f4-bdcf-c27e65dab83d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1574 microversion: 2.1 time: 0.203747 Jul 07 07:26:38.109026 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 409/801] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:37 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1574 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:38.128352 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:38.128986 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:38.135548 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:38.136268 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:38.137074 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:38.137543 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:38.173848 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:38.174324 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:38.174765 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lazy-loading 'fault' on Instance uuid e219f102-9056-42d4-86fd-4a0f8348d041 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:26:38.225868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cee7676762a04042a599439058ba90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e976a7167fc84b0ca11b4d0d1effcff3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:38.235057 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-720d2f2b-68a7-4f64-b271-036c5ec5d10b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 200 len: 1348 microversion: 2.1 time: 0.110711 Jul 07 07:26:38.247555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 393/802] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:38 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 1348 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:38.319211 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-8b5ae5a2-2964-4a15-8534-05ad585eb89b req-41d72574-b73e-4f06-9994-63b355a32cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83944e7d-3750-4747-92ae-6a1f735c79fc", "name": "network-vif-unplugged", "status": "completed", "tag": "19dfde08-41d9-41e9-b31b-405a6dc8008a"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:38.342821 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-8b5ae5a2-2964-4a15-8534-05ad585eb89b req-41d72574-b73e-4f06-9994-63b355a32cc8 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:38.343580 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-8b5ae5a2-2964-4a15-8534-05ad585eb89b req-41d72574-b73e-4f06-9994-63b355a32cc8 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:38.372411 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-42371c0e-dfe4-4a35-a048-babf9f075e4c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:38.373005 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-42371c0e-dfe4-4a35-a048-babf9f075e4c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:38.384608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42371c0e-dfe4-4a35-a048-babf9f075e4c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:38.385584 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42371c0e-dfe4-4a35-a048-babf9f075e4c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:38.388109 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42371c0e-dfe4-4a35-a048-babf9f075e4c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:38.389249 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42371c0e-dfe4-4a35-a048-babf9f075e4c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:38.399921 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.compute.server_external_events [req-8b5ae5a2-2964-4a15-8534-05ad585eb89b req-41d72574-b73e-4f06-9994-63b355a32cc8 service nova] Unable to find a host for instance 83944e7d-3750-4747-92ae-6a1f735c79fc. Dropping event network-vif-unplugged {{(pid=117787) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 07 07:26:38.399921 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-8b5ae5a2-2964-4a15-8534-05ad585eb89b req-41d72574-b73e-4f06-9994-63b355a32cc8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086994 Jul 07 07:26:38.410040 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 410/803] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 89 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 07 07:26:38.754464 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c688d84a-4481-433d-9937-03a533894f67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:38.755908 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c688d84a-4481-433d-9937-03a533894f67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:38.766788 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-42371c0e-dfe4-4a35-a048-babf9f075e4c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:38.774381 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c688d84a-4481-433d-9937-03a533894f67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:38.775757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c688d84a-4481-433d-9937-03a533894f67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:38.776709 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-42371c0e-dfe4-4a35-a048-babf9f075e4c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:38.777974 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c688d84a-4481-433d-9937-03a533894f67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:38.778476 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c688d84a-4481-433d-9937-03a533894f67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:38.778850 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-42371c0e-dfe4-4a35-a048-babf9f075e4c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:38.781188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-42371c0e-dfe4-4a35-a048-babf9f075e4c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.415936 Jul 07 07:26:38.788297 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 394/804] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:38 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:26:38.827524 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c688d84a-4481-433d-9937-03a533894f67 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078281 Jul 07 07:26:38.833165 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 411/805] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:38 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 07 07:26:38.961801 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a4478e4d-b49b-4e5c-aa47-64fc8b37384e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:38.963790 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a4478e4d-b49b-4e5c-aa47-64fc8b37384e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:38.978481 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4478e4d-b49b-4e5c-aa47-64fc8b37384e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:38.980536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4478e4d-b49b-4e5c-aa47-64fc8b37384e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:38.982103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4478e4d-b49b-4e5c-aa47-64fc8b37384e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:38.984033 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a4478e4d-b49b-4e5c-aa47-64fc8b37384e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:39.032746 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a4478e4d-b49b-4e5c-aa47-64fc8b37384e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077038 Jul 07 07:26:39.033344 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 395/806] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:38 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 07 07:26:39.114149 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0c960070-18f3-4fa5-81a9-24cbd0d9547f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:39.114707 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0c960070-18f3-4fa5-81a9-24cbd0d9547f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:39.126079 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-72b634d8-f350-4da2-b3e8-58c9bbe49996 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:39.126873 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-72b634d8-f350-4da2-b3e8-58c9bbe49996 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:39.133240 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c960070-18f3-4fa5-81a9-24cbd0d9547f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:39.137329 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72b634d8-f350-4da2-b3e8-58c9bbe49996 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:39.138144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c960070-18f3-4fa5-81a9-24cbd0d9547f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:39.138776 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72b634d8-f350-4da2-b3e8-58c9bbe49996 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:39.139733 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72b634d8-f350-4da2-b3e8-58c9bbe49996 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:39.140726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c960070-18f3-4fa5-81a9-24cbd0d9547f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:39.141740 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0c960070-18f3-4fa5-81a9-24cbd0d9547f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:39.142615 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-72b634d8-f350-4da2-b3e8-58c9bbe49996 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:39.182122 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0c960070-18f3-4fa5-81a9-24cbd0d9547f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:26:39.374091 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0c960070-18f3-4fa5-81a9-24cbd0d9547f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "DELETE /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 204 len: 0 microversion: 2.1 time: 0.264546 Jul 07 07:26:39.374756 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 412/807] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:26:39 2022] DELETE /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:26:39.380689 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7016bceb-2d4c-4ed2-a939-e3c47b84938e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:39.381421 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7016bceb-2d4c-4ed2-a939-e3c47b84938e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] [instance: e219f102-9056-42d4-86fd-4a0f8348d041] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:39.387584 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7016bceb-2d4c-4ed2-a939-e3c47b84938e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:39.388040 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7016bceb-2d4c-4ed2-a939-e3c47b84938e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:39.388801 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7016bceb-2d4c-4ed2-a939-e3c47b84938e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:39.389460 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7016bceb-2d4c-4ed2-a939-e3c47b84938e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:39.405456 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-7016bceb-2d4c-4ed2-a939-e3c47b84938e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] HTTP exception thrown: Instance e219f102-9056-42d4-86fd-4a0f8348d041 could not be found. Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7016bceb-2d4c-4ed2-a939-e3c47b84938e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Request method failure captured: Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 HTTP/1.1 Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixonpjWyZb1HjsRceHt944lVumI-EVDivnIo-PPCtVsC1Lze2wSWGZS0dnubHPZKzQOkKRk5aNJxoBs1ZXNaB6s5t8iWQtOFQ2OaxNKNF7s20NzipT4jijAj09GEBuPpBapethIVNDIDKOjGMZX-8JPf1Ms2-Ql2UPw7Ke1uZm03DP48 Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: e976a7167fc84b0ca11b4d0d1effcff3 Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestMinimumBasicScenario-1797266766 Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:26:39.407620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e976a7167fc84b0ca11b4d0d1effcff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e976a7167fc84b0ca11b4d0d1effcff3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e976a7167fc84b0ca11b4d0d1effcff3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e976a7167fc84b0ca11b4d0d1effcff3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestMinimumBasicScenario-1797266766 Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: e976a7167fc84b0ca11b4d0d1effcff3 Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1797266766 Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-TestMinimumBasicScenario-1797266766-project Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: cee7676762a04042a599439058ba90ad Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestMinimumBasicScenario-1797266766-project Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance e219f102-9056-42d4-86fd-4a0f8348d041 could not be found. Jul 07 07:26:39.409159 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': 'e219f102-9056-42d4-86fd-4a0f8348d041'} Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e219f102-9056-42d4-86fd-4a0f8348d041 could not be found. Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:26:39.410590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e219f102-9056-42d4-86fd-4a0f8348d041 could not be found. Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e219f102-9056-42d4-86fd-4a0f8348d041 could not be found. Jul 07 07:26:39.412546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:39.415412 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7016bceb-2d4c-4ed2-a939-e3c47b84938e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Returning 404 to user: Instance e219f102-9056-42d4-86fd-4a0f8348d041 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:26:39.416507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7016bceb-2d4c-4ed2-a939-e3c47b84938e tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041" status: 404 len: 111 microversion: 2.1 time: 0.040341 Jul 07 07:26:39.417281 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 413/808] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:39 2022] GET /compute/v2.1/servers/e219f102-9056-42d4-86fd-4a0f8348d041 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:26:39.428723 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-534d32cf-2c03-4db8-9856-af40d14a6b6e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:39.429810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-534d32cf-2c03-4db8-9856-af40d14a6b6e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:39.439578 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-534d32cf-2c03-4db8-9856-af40d14a6b6e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:39.441034 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-534d32cf-2c03-4db8-9856-af40d14a6b6e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:39.442101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-534d32cf-2c03-4db8-9856-af40d14a6b6e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:39.442726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-534d32cf-2c03-4db8-9856-af40d14a6b6e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:39.513191 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-72b634d8-f350-4da2-b3e8-58c9bbe49996 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:39.530672 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-72b634d8-f350-4da2-b3e8-58c9bbe49996 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1514 microversion: 2.1 time: 0.408907 Jul 07 07:26:39.531927 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 396/809] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:39 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1514 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:26:39.536618 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a76355d4-15b4-4b45-b166-7506d5de740b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] Calling method '.version_select at 0x7fccfa1781f0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:39.575924 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a76355d4-15b4-4b45-b166-7506d5de740b tempest-TestMinimumBasicScenario-1797266766 tempest-TestMinimumBasicScenario-1797266766-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-390493094" status: 202 len: 0 microversion: 2.1 time: 0.042711 Jul 07 07:26:39.576729 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 397/810] 10.222.0.62 () {58 vars in 1268 bytes} [Thu Jul 7 07:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-390493094 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:26:39.705924 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-534d32cf-2c03-4db8-9856-af40d14a6b6e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:39.716128 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-534d32cf-2c03-4db8-9856-af40d14a6b6e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1675 microversion: 2.1 time: 0.297630 Jul 07 07:26:39.726728 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 414/811] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:39 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1675 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:39.802018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-914ffd0c-271e-40b7-a319-dcc19b9f95cf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:39.802472 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-914ffd0c-271e-40b7-a319-dcc19b9f95cf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:39.813110 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-914ffd0c-271e-40b7-a319-dcc19b9f95cf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:39.813902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-914ffd0c-271e-40b7-a319-dcc19b9f95cf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:39.814954 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-914ffd0c-271e-40b7-a319-dcc19b9f95cf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:39.815573 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-914ffd0c-271e-40b7-a319-dcc19b9f95cf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:40.050085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-914ffd0c-271e-40b7-a319-dcc19b9f95cf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:40.066228 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-914ffd0c-271e-40b7-a319-dcc19b9f95cf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:40.068330 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-914ffd0c-271e-40b7-a319-dcc19b9f95cf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:40.069783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-914ffd0c-271e-40b7-a319-dcc19b9f95cf tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.273802 Jul 07 07:26:40.071056 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 398/812] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:39 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:40.548580 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-750b4d52-9b8f-41a5-87f4-cce3b36d13e3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:40.549922 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-750b4d52-9b8f-41a5-87f4-cce3b36d13e3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:40.558254 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-750b4d52-9b8f-41a5-87f4-cce3b36d13e3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:40.559153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-750b4d52-9b8f-41a5-87f4-cce3b36d13e3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:40.560193 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-750b4d52-9b8f-41a5-87f4-cce3b36d13e3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:40.560846 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-750b4d52-9b8f-41a5-87f4-cce3b36d13e3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:40.641497 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-07dca36c-22b7-45e4-9778-66ef46d27bbe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:40.643014 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-07dca36c-22b7-45e4-9778-66ef46d27bbe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:40.664542 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07dca36c-22b7-45e4-9778-66ef46d27bbe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:40.668818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07dca36c-22b7-45e4-9778-66ef46d27bbe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:40.671641 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07dca36c-22b7-45e4-9778-66ef46d27bbe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:40.674256 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07dca36c-22b7-45e4-9778-66ef46d27bbe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:40.745044 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:40.764345 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-07dca36c-22b7-45e4-9778-66ef46d27bbe tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/ips" status: 200 len: 150 microversion: 2.1 time: 0.127767 Jul 07 07:26:40.774123 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 399/813] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Jul 7 07:26:40 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/ips => generated 150 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:26:40.784693 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-986eedc5-a37a-4c62-8393-98a635d7962f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:40.785342 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-986eedc5-a37a-4c62-8393-98a635d7962f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:40.795651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-986eedc5-a37a-4c62-8393-98a635d7962f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:40.796092 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-986eedc5-a37a-4c62-8393-98a635d7962f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:40.799917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-986eedc5-a37a-4c62-8393-98a635d7962f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:40.800382 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-986eedc5-a37a-4c62-8393-98a635d7962f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:40.978347 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-750b4d52-9b8f-41a5-87f4-cce3b36d13e3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:40.998190 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-750b4d52-9b8f-41a5-87f4-cce3b36d13e3 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1514 microversion: 2.1 time: 0.453367 Jul 07 07:26:41.001680 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 415/814] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:40 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1514 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:41.089374 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-986eedc5-a37a-4c62-8393-98a635d7962f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:41.092693 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9db5d4be-bd50-4364-b7a1-f06b71081a4a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:41.093375 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9db5d4be-bd50-4364-b7a1-f06b71081a4a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:41.100535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-986eedc5-a37a-4c62-8393-98a635d7962f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1675 microversion: 2.1 time: 0.325236 Jul 07 07:26:41.105615 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 400/815] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:40 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:41.113097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9db5d4be-bd50-4364-b7a1-f06b71081a4a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:41.118041 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9db5d4be-bd50-4364-b7a1-f06b71081a4a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:41.119106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9db5d4be-bd50-4364-b7a1-f06b71081a4a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:41.121037 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9db5d4be-bd50-4364-b7a1-f06b71081a4a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:41.424283 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9db5d4be-bd50-4364-b7a1-f06b71081a4a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:41.433538 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9db5d4be-bd50-4364-b7a1-f06b71081a4a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:41.437173 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9db5d4be-bd50-4364-b7a1-f06b71081a4a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:41.438679 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9db5d4be-bd50-4364-b7a1-f06b71081a4a tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.353822 Jul 07 07:26:41.439299 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 416/816] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:41 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:42.019442 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4992059e-09f2-4746-9836-fdd86383f454 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:42.020220 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4992059e-09f2-4746-9836-fdd86383f454 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:42.029969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4992059e-09f2-4746-9836-fdd86383f454 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:42.029969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4992059e-09f2-4746-9836-fdd86383f454 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:42.031663 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4992059e-09f2-4746-9836-fdd86383f454 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:42.032516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4992059e-09f2-4746-9836-fdd86383f454 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:42.123460 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b0edb743-75fa-4694-adbf-edeed195f97e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:42.126170 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b0edb743-75fa-4694-adbf-edeed195f97e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:42.134233 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0edb743-75fa-4694-adbf-edeed195f97e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:42.135107 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0edb743-75fa-4694-adbf-edeed195f97e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:42.136297 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0edb743-75fa-4694-adbf-edeed195f97e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:42.137446 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b0edb743-75fa-4694-adbf-edeed195f97e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:42.273115 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4992059e-09f2-4746-9836-fdd86383f454 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:42.286932 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4992059e-09f2-4746-9836-fdd86383f454 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1516 microversion: 2.1 time: 0.271757 Jul 07 07:26:42.291466 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 401/817] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:42 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1516 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:42.349873 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b0edb743-75fa-4694-adbf-edeed195f97e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:42.366163 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b0edb743-75fa-4694-adbf-edeed195f97e tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1675 microversion: 2.1 time: 0.248613 Jul 07 07:26:42.368358 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 417/818] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:42 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1675 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:26:42.441451 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aaff6630-6129-4ba5-bbd1-509ea174ff73 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8ed190a-9788-481a-ab1d-147f875ffb34"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:42.442885 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aaff6630-6129-4ba5-bbd1-509ea174ff73 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:42.458816 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-82d2ab24-6711-4450-97be-8743b3b7b826 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:42.459425 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-82d2ab24-6711-4450-97be-8743b3b7b826 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:42.461898 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aaff6630-6129-4ba5-bbd1-509ea174ff73 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:42.463118 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aaff6630-6129-4ba5-bbd1-509ea174ff73 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:42.466437 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aaff6630-6129-4ba5-bbd1-509ea174ff73 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:42.467078 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aaff6630-6129-4ba5-bbd1-509ea174ff73 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:42.473054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82d2ab24-6711-4450-97be-8743b3b7b826 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:42.473912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82d2ab24-6711-4450-97be-8743b3b7b826 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:42.474734 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82d2ab24-6711-4450-97be-8743b3b7b826 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:42.481889 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82d2ab24-6711-4450-97be-8743b3b7b826 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:42.728716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-82d2ab24-6711-4450-97be-8743b3b7b826 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:42.739379 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-82d2ab24-6711-4450-97be-8743b3b7b826 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:42.741035 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-82d2ab24-6711-4450-97be-8743b3b7b826 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:42.742655 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-82d2ab24-6711-4450-97be-8743b3b7b826 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.288544 Jul 07 07:26:42.744908 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 418/819] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:42 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:42.977377 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aaff6630-6129-4ba5-bbd1-509ea174ff73 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "POST /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543233 Jul 07 07:26:42.988286 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 402/820] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:26:42 2022] POST /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-volume_attachments => generated 194 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:43.309361 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a8b6c066-ed60-468a-9a8a-2543eddd12aa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:43.310347 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a8b6c066-ed60-468a-9a8a-2543eddd12aa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:43.318031 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8b6c066-ed60-468a-9a8a-2543eddd12aa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:43.327728 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8b6c066-ed60-468a-9a8a-2543eddd12aa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:43.329109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8b6c066-ed60-468a-9a8a-2543eddd12aa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:43.329897 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a8b6c066-ed60-468a-9a8a-2543eddd12aa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:43.369954 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:43.386027 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-318af287-6f61-469b-86a8-2529cd4f63d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:43.386857 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-318af287-6f61-469b-86a8-2529cd4f63d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:43.415623 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-318af287-6f61-469b-86a8-2529cd4f63d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:43.417196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-318af287-6f61-469b-86a8-2529cd4f63d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:43.418731 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-318af287-6f61-469b-86a8-2529cd4f63d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:43.420662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-318af287-6f61-469b-86a8-2529cd4f63d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:43.539365 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-318af287-6f61-469b-86a8-2529cd4f63d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:43.551031 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-318af287-6f61-469b-86a8-2529cd4f63d7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1607 microversion: 2.1 time: 0.166447 Jul 07 07:26:43.551764 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 403/821] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:43 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1607 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:26:43.655767 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a8b6c066-ed60-468a-9a8a-2543eddd12aa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:43.667505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a8b6c066-ed60-468a-9a8a-2543eddd12aa tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.362538 Jul 07 07:26:43.669122 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 419/822] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:43 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:43.761369 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0ac7f086-6b1c-4011-8838-c27a45d7a6a9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:43.763019 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0ac7f086-6b1c-4011-8838-c27a45d7a6a9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:43.771727 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ac7f086-6b1c-4011-8838-c27a45d7a6a9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:43.772422 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ac7f086-6b1c-4011-8838-c27a45d7a6a9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:43.773432 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ac7f086-6b1c-4011-8838-c27a45d7a6a9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:43.774022 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0ac7f086-6b1c-4011-8838-c27a45d7a6a9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:44.025967 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0ac7f086-6b1c-4011-8838-c27a45d7a6a9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:44.040014 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0ac7f086-6b1c-4011-8838-c27a45d7a6a9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:44.041620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0ac7f086-6b1c-4011-8838-c27a45d7a6a9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:44.046165 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0ac7f086-6b1c-4011-8838-c27a45d7a6a9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.289374 Jul 07 07:26:44.046751 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 404/823] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:43 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:44.572301 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7a6daff7-1600-49c3-988a-9312363d32f5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:44.572929 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7a6daff7-1600-49c3-988a-9312363d32f5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:44.588604 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a6daff7-1600-49c3-988a-9312363d32f5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:44.589731 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a6daff7-1600-49c3-988a-9312363d32f5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:44.590902 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a6daff7-1600-49c3-988a-9312363d32f5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:44.591343 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7a6daff7-1600-49c3-988a-9312363d32f5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:44.670833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7a6daff7-1600-49c3-988a-9312363d32f5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:44.679524 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7a6daff7-1600-49c3-988a-9312363d32f5 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1607 microversion: 2.1 time: 0.114394 Jul 07 07:26:44.680576 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 420/824] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:44 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1607 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:44.685959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-82ceb2de-db07-4a5b-a405-59efb454e6bf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:44.686631 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-82ceb2de-db07-4a5b-a405-59efb454e6bf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:44.696635 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82ceb2de-db07-4a5b-a405-59efb454e6bf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:44.698839 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82ceb2de-db07-4a5b-a405-59efb454e6bf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:44.703539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82ceb2de-db07-4a5b-a405-59efb454e6bf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:44.704741 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-82ceb2de-db07-4a5b-a405-59efb454e6bf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:44.964150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-9ac0ec23-ebe7-44b8-96c6-85eccc94266b req-bb71f5a4-04ff-49d4-9c88-e654fb7b3555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14904778-9fa1-42ab-9f55-44a650b96877", "name": "network-vif-deleted", "tag": "8e8e0c70-6136-45d2-8c16-1484b1913b94"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:44.996833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-9ac0ec23-ebe7-44b8-96c6-85eccc94266b req-bb71f5a4-04ff-49d4-9c88-e654fb7b3555 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:44.998952 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-9ac0ec23-ebe7-44b8-96c6-85eccc94266b req-bb71f5a4-04ff-49d4-9c88-e654fb7b3555 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:45.028909 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-9ac0ec23-ebe7-44b8-96c6-85eccc94266b req-bb71f5a4-04ff-49d4-9c88-e654fb7b3555 service nova] Creating event network-vif-deleted:8e8e0c70-6136-45d2-8c16-1484b1913b94 for instance 14904778-9fa1-42ab-9f55-44a650b96877 on hv-cinder-82660 Jul 07 07:26:45.038544 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-9ac0ec23-ebe7-44b8-96c6-85eccc94266b req-bb71f5a4-04ff-49d4-9c88-e654fb7b3555 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079598 Jul 07 07:26:45.039456 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 421/825] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:45.067772 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a0dfb50e-e3c2-4dc8-b361-218cd67fb46c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:45.068475 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a0dfb50e-e3c2-4dc8-b361-218cd67fb46c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:45.076341 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0dfb50e-e3c2-4dc8-b361-218cd67fb46c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:45.076809 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0dfb50e-e3c2-4dc8-b361-218cd67fb46c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:45.082978 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0dfb50e-e3c2-4dc8-b361-218cd67fb46c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:45.083444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a0dfb50e-e3c2-4dc8-b361-218cd67fb46c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:45.171013 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-82ceb2de-db07-4a5b-a405-59efb454e6bf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:45.196742 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-82ceb2de-db07-4a5b-a405-59efb454e6bf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.506085 Jul 07 07:26:45.203774 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 405/826] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:44 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:45.699105 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:45.700879 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:45.719383 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:45.727943 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:45.729494 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:45.731010 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:45.751067 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a0dfb50e-e3c2-4dc8-b361-218cd67fb46c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:45.767294 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a0dfb50e-e3c2-4dc8-b361-218cd67fb46c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:45.769129 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a0dfb50e-e3c2-4dc8-b361-218cd67fb46c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:45.770598 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a0dfb50e-e3c2-4dc8-b361-218cd67fb46c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.707622 Jul 07 07:26:45.772397 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 422/827] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:45 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:45.830262 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:45.830623 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:45.835820 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lazy-loading 'fault' on Instance uuid 14904778-9fa1-42ab-9f55-44a650b96877 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:26:46.035185 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16293fa03ced44cc994a0b8ad19ebb89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c14f84eaf04060acc489e77027c824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:46.042241 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-086e5e8d-acaf-45cb-b6fc-1213669aa89f tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 200 len: 1327 microversion: 2.1 time: 0.347554 Jul 07 07:26:46.048693 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 406/828] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:45 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 1327 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:46.214152 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-463b2a24-0faa-4f4b-a55f-50764a771452 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:46.215117 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-463b2a24-0faa-4f4b-a55f-50764a771452 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:46.227225 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-463b2a24-0faa-4f4b-a55f-50764a771452 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:46.227976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-463b2a24-0faa-4f4b-a55f-50764a771452 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:46.228931 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-463b2a24-0faa-4f4b-a55f-50764a771452 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:46.229546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-463b2a24-0faa-4f4b-a55f-50764a771452 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:46.576661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-463b2a24-0faa-4f4b-a55f-50764a771452 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:46.603201 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-463b2a24-0faa-4f4b-a55f-50764a771452 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.392180 Jul 07 07:26:46.609927 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 423/829] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:46 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:46.794097 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8d60259f-8377-411a-b43a-cb9f6ab1d0d5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:46.795147 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8d60259f-8377-411a-b43a-cb9f6ab1d0d5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:46.811188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d60259f-8377-411a-b43a-cb9f6ab1d0d5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:46.812230 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d60259f-8377-411a-b43a-cb9f6ab1d0d5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:46.816322 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d60259f-8377-411a-b43a-cb9f6ab1d0d5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:46.818757 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8d60259f-8377-411a-b43a-cb9f6ab1d0d5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:47.067512 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8c4ba4ff-ddaa-4eea-bafe-f37de7a147e7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:47.068145 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8c4ba4ff-ddaa-4eea-bafe-f37de7a147e7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:47.094495 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c4ba4ff-ddaa-4eea-bafe-f37de7a147e7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:47.095839 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c4ba4ff-ddaa-4eea-bafe-f37de7a147e7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:47.097995 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c4ba4ff-ddaa-4eea-bafe-f37de7a147e7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:47.098802 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8c4ba4ff-ddaa-4eea-bafe-f37de7a147e7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:47.123654 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-8c4ba4ff-ddaa-4eea-bafe-f37de7a147e7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] HTTP exception thrown: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8c4ba4ff-ddaa-4eea-bafe-f37de7a147e7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Request method failure captured: Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 HTTP/1.1 Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixokwC6C6f5sc-IWaiilecIlWZW-JLtNFu0gVWJEv1gOFObdfRmiK0o672cLL3vOtXZNAm1m9xX6qdCcT7R6SvT5_8ycXo3s0DjB_O-PWCXD-Vg4BiISEZFGuZerMHfNgs25V7fABgtONSHYmI0ux_tLXuwRIrhRQHqQ8gxQRw6sWWa0 Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:26:47.126539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_35c14f84eaf04060acc489e77027c824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/35c14f84eaf04060acc489e77027c824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 16293fa03ced44cc994a0b8ad19ebb89 Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:47.127983 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '14904778-9fa1-42ab-9f55-44a650b96877'} Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:26:47.128716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:47.129960 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:47.141781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8c4ba4ff-ddaa-4eea-bafe-f37de7a147e7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Returning 404 to user: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:26:47.143041 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8c4ba4ff-ddaa-4eea-bafe-f37de7a147e7 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 404 len: 111 microversion: 2.1 time: 0.079570 Jul 07 07:26:47.148482 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 424/830] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:47 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 07:26:47.159420 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-15510175-2cee-4ada-98aa-13ae07503cde tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '.version_select at 0x7fccfa26fb80>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:47.176330 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8d60259f-8377-411a-b43a-cb9f6ab1d0d5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:47.192904 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8d60259f-8377-411a-b43a-cb9f6ab1d0d5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:47.218545 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8d60259f-8377-411a-b43a-cb9f6ab1d0d5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:47.220039 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8d60259f-8377-411a-b43a-cb9f6ab1d0d5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.430581 Jul 07 07:26:47.220783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 407/831] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:46 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:47.237567 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-15510175-2cee-4ada-98aa-13ae07503cde tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-150488889" status: 202 len: 0 microversion: 2.1 time: 0.087268 Jul 07 07:26:47.239005 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 425/832] 10.222.0.62 () {58 vars in 1217 bytes} [Thu Jul 7 07:26:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-150488889 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:26:47.621598 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cabc1e39-7bc7-42b3-9d3a-96a6c6ac2077 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:47.622345 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cabc1e39-7bc7-42b3-9d3a-96a6c6ac2077 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:47.631769 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cabc1e39-7bc7-42b3-9d3a-96a6c6ac2077 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:47.636392 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cabc1e39-7bc7-42b3-9d3a-96a6c6ac2077 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:47.637959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cabc1e39-7bc7-42b3-9d3a-96a6c6ac2077 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:47.638473 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cabc1e39-7bc7-42b3-9d3a-96a6c6ac2077 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:48.063508 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cabc1e39-7bc7-42b3-9d3a-96a6c6ac2077 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:48.071413 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cabc1e39-7bc7-42b3-9d3a-96a6c6ac2077 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.453857 Jul 07 07:26:48.071991 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 408/833] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:47 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:48.239418 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-81959ea2-2545-4ed9-9667-256fce90bc57 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:48.240833 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-81959ea2-2545-4ed9-9667-256fce90bc57 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:48.244014 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:48.261208 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81959ea2-2545-4ed9-9667-256fce90bc57 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:48.263981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81959ea2-2545-4ed9-9667-256fce90bc57 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:48.267476 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81959ea2-2545-4ed9-9667-256fce90bc57 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:48.269013 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-81959ea2-2545-4ed9-9667-256fce90bc57 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:48.654189 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-81959ea2-2545-4ed9-9667-256fce90bc57 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:48.670630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-81959ea2-2545-4ed9-9667-256fce90bc57 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:48.673517 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-81959ea2-2545-4ed9-9667-256fce90bc57 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:48.677787 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-81959ea2-2545-4ed9-9667-256fce90bc57 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.442075 Jul 07 07:26:48.689686 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 426/834] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:48 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:49.088666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e4aceb91-2be0-4a92-b56e-8b8d07555f4c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:49.089376 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e4aceb91-2be0-4a92-b56e-8b8d07555f4c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:49.097456 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4aceb91-2be0-4a92-b56e-8b8d07555f4c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:49.097919 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4aceb91-2be0-4a92-b56e-8b8d07555f4c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:49.098877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4aceb91-2be0-4a92-b56e-8b8d07555f4c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:49.099502 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4aceb91-2be0-4a92-b56e-8b8d07555f4c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:49.328655 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4aceb91-2be0-4a92-b56e-8b8d07555f4c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:49.339952 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e4aceb91-2be0-4a92-b56e-8b8d07555f4c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.254808 Jul 07 07:26:49.341307 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 409/835] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:49 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:49.696363 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d52cb6b0-29f7-4d29-a06e-1ef26173db9e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:49.696943 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d52cb6b0-29f7-4d29-a06e-1ef26173db9e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:49.704755 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d52cb6b0-29f7-4d29-a06e-1ef26173db9e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:49.712533 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d52cb6b0-29f7-4d29-a06e-1ef26173db9e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:49.713590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d52cb6b0-29f7-4d29-a06e-1ef26173db9e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:49.714182 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d52cb6b0-29f7-4d29-a06e-1ef26173db9e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:49.979412 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d52cb6b0-29f7-4d29-a06e-1ef26173db9e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:49.990424 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d52cb6b0-29f7-4d29-a06e-1ef26173db9e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:49.992279 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d52cb6b0-29f7-4d29-a06e-1ef26173db9e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:49.998609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d52cb6b0-29f7-4d29-a06e-1ef26173db9e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.306111 Jul 07 07:26:49.999459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 427/836] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:49 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:50.358208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-71385029-5cef-410a-a9e7-b3206aa8726e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:50.359414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-71385029-5cef-410a-a9e7-b3206aa8726e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:50.370186 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71385029-5cef-410a-a9e7-b3206aa8726e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:50.370958 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71385029-5cef-410a-a9e7-b3206aa8726e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:50.371885 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71385029-5cef-410a-a9e7-b3206aa8726e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:50.372467 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-71385029-5cef-410a-a9e7-b3206aa8726e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:50.571814 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-71385029-5cef-410a-a9e7-b3206aa8726e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:50.582473 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-71385029-5cef-410a-a9e7-b3206aa8726e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.228528 Jul 07 07:26:50.594937 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 410/837] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:50 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:51.023356 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ac6b5e2b-0580-4f5d-a6cf-0eadb9ba2810 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:51.024051 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ac6b5e2b-0580-4f5d-a6cf-0eadb9ba2810 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:51.036802 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac6b5e2b-0580-4f5d-a6cf-0eadb9ba2810 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.038254 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac6b5e2b-0580-4f5d-a6cf-0eadb9ba2810 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.039493 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac6b5e2b-0580-4f5d-a6cf-0eadb9ba2810 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.040160 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ac6b5e2b-0580-4f5d-a6cf-0eadb9ba2810 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.234613 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b91128b0-7b34-4890-aae6-acd825723b44 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:51.235208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b91128b0-7b34-4890-aae6-acd825723b44 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:51.249608 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b91128b0-7b34-4890-aae6-acd825723b44 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.250320 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b91128b0-7b34-4890-aae6-acd825723b44 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.251275 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b91128b0-7b34-4890-aae6-acd825723b44 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.251853 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b91128b0-7b34-4890-aae6-acd825723b44 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.375250 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ac6b5e2b-0580-4f5d-a6cf-0eadb9ba2810 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:51.395935 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ac6b5e2b-0580-4f5d-a6cf-0eadb9ba2810 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:51.398069 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ac6b5e2b-0580-4f5d-a6cf-0eadb9ba2810 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:51.399699 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ac6b5e2b-0580-4f5d-a6cf-0eadb9ba2810 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.386383 Jul 07 07:26:51.420491 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 428/838] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:51 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:51.426032 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f143125-9780-4eaf-b427-b45b32867d6a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:51.427832 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-0f143125-9780-4eaf-b427-b45b32867d6a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:51.436898 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f143125-9780-4eaf-b427-b45b32867d6a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.437924 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-b91128b0-7b34-4890-aae6-acd825723b44 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lazy-loading 'services' on Instance uuid 241d4c02-22a4-4c03-9cf1-9708f5de3922 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:26:51.438375 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f143125-9780-4eaf-b427-b45b32867d6a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.439188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f143125-9780-4eaf-b427-b45b32867d6a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.439634 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-0f143125-9780-4eaf-b427-b45b32867d6a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.461648 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-0f143125-9780-4eaf-b427-b45b32867d6a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] HTTP exception thrown: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f143125-9780-4eaf-b427-b45b32867d6a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Request method failure captured: Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 HTTP/1.1 Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixokwC6C6f5sc-IWaiilecIlWZW-JLtNFu0gVWJEv1gOFObdfRmiK0o672cLL3vOtXZNAm1m9xX6qdCcT7R6SvT5_8ycXo3s0DjB_O-PWCXD-Vg4BiISEZFGuZerMHfNgs25V7fABgtONSHYmI0ux_tLXuwRIrhRQHqQ8gxQRw6sWWa0 Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:26:51.463726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_35c14f84eaf04060acc489e77027c824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/35c14f84eaf04060acc489e77027c824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 16293fa03ced44cc994a0b8ad19ebb89 Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:51.465587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '14904778-9fa1-42ab-9f55-44a650b96877'} Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:26:51.466469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:51.467919 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:51.472042 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0f143125-9780-4eaf-b427-b45b32867d6a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Returning 404 to user: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:26:51.473686 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0f143125-9780-4eaf-b427-b45b32867d6a tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "DELETE /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 404 len: 111 microversion: 2.1 time: 0.051723 Jul 07 07:26:51.478097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 429/839] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:26:51 2022] DELETE /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:26:51.497632 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-57d0667c-d628-4b4f-985d-3f6353768449 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:51.500545 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-57d0667c-d628-4b4f-985d-3f6353768449 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: 14904778-9fa1-42ab-9f55-44a650b96877] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:51.513488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57d0667c-d628-4b4f-985d-3f6353768449 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.514098 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57d0667c-d628-4b4f-985d-3f6353768449 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.515003 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57d0667c-d628-4b4f-985d-3f6353768449 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.515525 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57d0667c-d628-4b4f-985d-3f6353768449 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.542096 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-57d0667c-d628-4b4f-985d-3f6353768449 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] HTTP exception thrown: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-57d0667c-d628-4b4f-985d-3f6353768449 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Request method failure captured: Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 HTTP/1.1 Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixokwC6C6f5sc-IWaiilecIlWZW-JLtNFu0gVWJEv1gOFObdfRmiK0o672cLL3vOtXZNAm1m9xX6qdCcT7R6SvT5_8ycXo3s0DjB_O-PWCXD-Vg4BiISEZFGuZerMHfNgs25V7fABgtONSHYmI0ux_tLXuwRIrhRQHqQ8gxQRw6sWWa0 Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:26:51.543841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_35c14f84eaf04060acc489e77027c824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/35c14f84eaf04060acc489e77027c824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 16293fa03ced44cc994a0b8ad19ebb89 Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:51.545494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '14904778-9fa1-42ab-9f55-44a650b96877'} Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:26:51.546350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. Jul 07 07:26:51.547766 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:26:51.549025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-57d0667c-d628-4b4f-985d-3f6353768449 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Returning 404 to user: Instance 14904778-9fa1-42ab-9f55-44a650b96877 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:26:51.550014 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-57d0667c-d628-4b4f-985d-3f6353768449 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877" status: 404 len: 111 microversion: 2.1 time: 0.068002 Jul 07 07:26:51.554036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 430/840] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:51 2022] GET /compute/v2.1/servers/14904778-9fa1-42ab-9f55-44a650b96877 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:26:51.604483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b91128b0-7b34-4890-aae6-acd825723b44 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-volume_attachments/d8ed190a-9788-481a-ab1d-147f875ffb34" status: 202 len: 0 microversion: 2.1 time: 0.376206 Jul 07 07:26:51.605840 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 411/841] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:26:51 2022] DELETE /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-volume_attachments/d8ed190a-9788-481a-ab1d-147f875ffb34 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:26:51.609948 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3de02d62-66a3-4c72-9141-9c53329e1adf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:51.610623 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3de02d62-66a3-4c72-9141-9c53329e1adf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:51.617892 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-564f8066-62d1-4e7c-b10e-0fe9b401a088 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:51.619612 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-564f8066-62d1-4e7c-b10e-0fe9b401a088 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:51.626179 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3de02d62-66a3-4c72-9141-9c53329e1adf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.626642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3de02d62-66a3-4c72-9141-9c53329e1adf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.627442 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3de02d62-66a3-4c72-9141-9c53329e1adf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.627892 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3de02d62-66a3-4c72-9141-9c53329e1adf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.629024 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-564f8066-62d1-4e7c-b10e-0fe9b401a088 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.629605 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-564f8066-62d1-4e7c-b10e-0fe9b401a088 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.630536 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-564f8066-62d1-4e7c-b10e-0fe9b401a088 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:51.631237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-564f8066-62d1-4e7c-b10e-0fe9b401a088 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:51.679333 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-564f8066-62d1-4e7c-b10e-0fe9b401a088 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068827 Jul 07 07:26:51.681781 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 412/842] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:51 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:51.859197 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-3de02d62-66a3-4c72-9141-9c53329e1adf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:51.868045 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3de02d62-66a3-4c72-9141-9c53329e1adf tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.270404 Jul 07 07:26:51.879497 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 431/843] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:51 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:52.426446 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-21719270-033e-4a81-9162-e0746adb9805 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:52.427278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-21719270-033e-4a81-9162-e0746adb9805 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:52.438793 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-21719270-033e-4a81-9162-e0746adb9805 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:52.439944 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-21719270-033e-4a81-9162-e0746adb9805 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:52.440904 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-21719270-033e-4a81-9162-e0746adb9805 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:52.441571 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-21719270-033e-4a81-9162-e0746adb9805 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:52.641814 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-21719270-033e-4a81-9162-e0746adb9805 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:52.650096 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-21719270-033e-4a81-9162-e0746adb9805 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:52.651604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-21719270-033e-4a81-9162-e0746adb9805 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:52.652810 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-21719270-033e-4a81-9162-e0746adb9805 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.238022 Jul 07 07:26:52.667322 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 413/844] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:52 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:52.694592 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-32adf98f-022b-47d3-907e-90612743f960 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:52.696317 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-32adf98f-022b-47d3-907e-90612743f960 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:52.707188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32adf98f-022b-47d3-907e-90612743f960 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:52.708076 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32adf98f-022b-47d3-907e-90612743f960 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:52.709485 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32adf98f-022b-47d3-907e-90612743f960 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:52.710477 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-32adf98f-022b-47d3-907e-90612743f960 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:52.807070 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-32adf98f-022b-47d3-907e-90612743f960 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118777 Jul 07 07:26:52.808679 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 432/845] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:52 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:52.855659 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f1ca280a-a1e2-45a4-a9f4-48a368f37315 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:52.856152 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-f1ca280a-a1e2-45a4-a9f4-48a368f37315 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:52.876720 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1ca280a-a1e2-45a4-a9f4-48a368f37315 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:52.882457 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1ca280a-a1e2-45a4-a9f4-48a368f37315 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:52.884588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1ca280a-a1e2-45a4-a9f4-48a368f37315 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:52.886062 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-f1ca280a-a1e2-45a4-a9f4-48a368f37315 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:52.888327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-48791891-aa25-442f-be9f-afc018f70115 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:52.889746 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-48791891-aa25-442f-be9f-afc018f70115 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:52.902526 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48791891-aa25-442f-be9f-afc018f70115 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:52.904697 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48791891-aa25-442f-be9f-afc018f70115 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:52.906659 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48791891-aa25-442f-be9f-afc018f70115 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:52.907535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48791891-aa25-442f-be9f-afc018f70115 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:52.914932 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:52.939916 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-f1ca280a-a1e2-45a4-a9f4-48a368f37315 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] HTTP exception thrown: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f1ca280a-a1e2-45a4-a9f4-48a368f37315 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Request method failure captured: Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 HTTP/1.1 Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixokwC6C6f5sc-IWaiilecIlWZW-JLtNFu0gVWJEv1gOFObdfRmiK0o672cLL3vOtXZNAm1m9xX6qdCcT7R6SvT5_8ycXo3s0DjB_O-PWCXD-Vg4BiISEZFGuZerMHfNgs25V7fABgtONSHYmI0ux_tLXuwRIrhRQHqQ8gxQRw6sWWa0 Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:26:52.942208 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_35c14f84eaf04060acc489e77027c824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/35c14f84eaf04060acc489e77027c824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 16293fa03ced44cc994a0b8ad19ebb89 Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:26:52.943828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'ec188266-15a7-4559-ab29-6025dd7837e5'} Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:26:52.944704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:26:52.946193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:52.950241 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-f1ca280a-a1e2-45a4-a9f4-48a368f37315 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Returning 404 to user: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:26:52.953691 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-f1ca280a-a1e2-45a4-a9f4-48a368f37315 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 404 len: 111 microversion: 2.1 time: 0.099796 Jul 07 07:26:52.955886 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 414/846] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:26:52 2022] DELETE /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 07:26:52.973462 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b681a4b0-ff91-4f3a-b918-2644c3de6f05 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:52.974173 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b681a4b0-ff91-4f3a-b918-2644c3de6f05 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] [instance: ec188266-15a7-4559-ab29-6025dd7837e5] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:53.004903 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b681a4b0-ff91-4f3a-b918-2644c3de6f05 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:53.005686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b681a4b0-ff91-4f3a-b918-2644c3de6f05 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:53.006927 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b681a4b0-ff91-4f3a-b918-2644c3de6f05 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:53.008072 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b681a4b0-ff91-4f3a-b918-2644c3de6f05 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:53.050272 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-b681a4b0-ff91-4f3a-b918-2644c3de6f05 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] HTTP exception thrown: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b681a4b0-ff91-4f3a-b918-2644c3de6f05 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Request method failure captured: Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 HTTP/1.1 Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixokwC6C6f5sc-IWaiilecIlWZW-JLtNFu0gVWJEv1gOFObdfRmiK0o672cLL3vOtXZNAm1m9xX6qdCcT7R6SvT5_8ycXo3s0DjB_O-PWCXD-Vg4BiISEZFGuZerMHfNgs25V7fABgtONSHYmI0ux_tLXuwRIrhRQHqQ8gxQRw6sWWa0 Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:26:53.051917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/35c14f84eaf04060acc489e77027c824"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_35c14f84eaf04060acc489e77027c824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/35c14f84eaf04060acc489e77027c824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 35c14f84eaf04060acc489e77027c824 Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1691477201 Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 16293fa03ced44cc994a0b8ad19ebb89 Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeTestJSON-1691477201-project Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:26:53.054163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'ec188266-15a7-4559-ab29-6025dd7837e5'} Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:26:53.055058 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. Jul 07 07:26:53.056710 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:26:53.058776 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b681a4b0-ff91-4f3a-b918-2644c3de6f05 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] Returning 404 to user: Instance ec188266-15a7-4559-ab29-6025dd7837e5 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:26:53.058776 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b681a4b0-ff91-4f3a-b918-2644c3de6f05 tempest-AttachVolumeTestJSON-1691477201 tempest-AttachVolumeTestJSON-1691477201-project] 10.222.0.62 "GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5" status: 404 len: 111 microversion: 2.1 time: 0.093189 Jul 07 07:26:53.058776 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 415/847] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:52 2022] GET /compute/v2.1/servers/ec188266-15a7-4559-ab29-6025dd7837e5 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:26:53.670791 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e4b5d145-128c-463b-80a4-a573d0923028 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:53.672254 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e4b5d145-128c-463b-80a4-a573d0923028 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:53.692763 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4b5d145-128c-463b-80a4-a573d0923028 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:53.693906 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4b5d145-128c-463b-80a4-a573d0923028 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:53.695273 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4b5d145-128c-463b-80a4-a573d0923028 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:53.698859 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e4b5d145-128c-463b-80a4-a573d0923028 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:53.759543 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-48791891-aa25-442f-be9f-afc018f70115 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:53.768807 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-48791891-aa25-442f-be9f-afc018f70115 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.885854 Jul 07 07:26:53.769409 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 433/848] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:52 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:53.821498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-014f9d37-2cca-4c0b-bddf-07f789ee826f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:53.822761 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-014f9d37-2cca-4c0b-bddf-07f789ee826f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:53.835642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-014f9d37-2cca-4c0b-bddf-07f789ee826f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:53.841626 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-014f9d37-2cca-4c0b-bddf-07f789ee826f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:53.842973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-014f9d37-2cca-4c0b-bddf-07f789ee826f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:53.843848 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-014f9d37-2cca-4c0b-bddf-07f789ee826f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:53.885842 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-014f9d37-2cca-4c0b-bddf-07f789ee826f tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068359 Jul 07 07:26:53.903920 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 434/849] 10.222.0.62 () {58 vars in 1301 bytes} [Thu Jul 7 07:26:53 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 07 07:26:53.957703 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1d1fe321-2af7-4c0c-b2b2-fbe660c44055 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:53.958593 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1d1fe321-2af7-4c0c-b2b2-fbe660c44055 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:53.966429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d1fe321-2af7-4c0c-b2b2-fbe660c44055 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:53.967476 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d1fe321-2af7-4c0c-b2b2-fbe660c44055 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:53.969777 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d1fe321-2af7-4c0c-b2b2-fbe660c44055 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:53.971238 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1d1fe321-2af7-4c0c-b2b2-fbe660c44055 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:54.040603 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1d1fe321-2af7-4c0c-b2b2-fbe660c44055 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:26:54.195964 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4b5d145-128c-463b-80a4-a573d0923028 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:54.204966 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4b5d145-128c-463b-80a4-a573d0923028 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:54.221834 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e4b5d145-128c-463b-80a4-a573d0923028 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:54.223260 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e4b5d145-128c-463b-80a4-a573d0923028 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.556401 Jul 07 07:26:54.224408 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 416/850] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:53 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:26:54.240277 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1d1fe321-2af7-4c0c-b2b2-fbe660c44055 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 204 len: 0 microversion: 2.1 time: 0.286534 Jul 07 07:26:54.243548 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 435/851] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:26:53 2022] DELETE /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:26:54.253961 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2a100c66-9045-4dad-8680-fdfa4739270d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:54.254693 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2a100c66-9045-4dad-8680-fdfa4739270d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:54.281051 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a100c66-9045-4dad-8680-fdfa4739270d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:54.281666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a100c66-9045-4dad-8680-fdfa4739270d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:54.283061 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a100c66-9045-4dad-8680-fdfa4739270d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:54.284075 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-2a100c66-9045-4dad-8680-fdfa4739270d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:54.629324 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2a100c66-9045-4dad-8680-fdfa4739270d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:54.636788 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2a100c66-9045-4dad-8680-fdfa4739270d tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1682 microversion: 2.1 time: 0.387935 Jul 07 07:26:54.646645 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 417/852] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:54 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1682 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:54.787747 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f3b0f742-53e9-4a57-939a-111b7d64d891 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:54.788624 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f3b0f742-53e9-4a57-939a-111b7d64d891 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:54.802580 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3b0f742-53e9-4a57-939a-111b7d64d891 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:54.803131 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3b0f742-53e9-4a57-939a-111b7d64d891 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:54.805123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3b0f742-53e9-4a57-939a-111b7d64d891 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:54.810250 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f3b0f742-53e9-4a57-939a-111b7d64d891 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:55.096647 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f3b0f742-53e9-4a57-939a-111b7d64d891 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:55.108164 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f3b0f742-53e9-4a57-939a-111b7d64d891 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.324572 Jul 07 07:26:55.111021 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 436/853] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:54 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:55.242652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4173f86d-c5bf-4da2-b836-84848814fd24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:55.244020 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4173f86d-c5bf-4da2-b836-84848814fd24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:55.252045 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4173f86d-c5bf-4da2-b836-84848814fd24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:55.252694 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4173f86d-c5bf-4da2-b836-84848814fd24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:55.253673 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4173f86d-c5bf-4da2-b836-84848814fd24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:55.254261 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4173f86d-c5bf-4da2-b836-84848814fd24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:55.450798 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4173f86d-c5bf-4da2-b836-84848814fd24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:55.468158 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4173f86d-c5bf-4da2-b836-84848814fd24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:55.469935 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4173f86d-c5bf-4da2-b836-84848814fd24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:55.474918 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4173f86d-c5bf-4da2-b836-84848814fd24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1740 microversion: 2.20 time: 0.235749 Jul 07 07:26:55.475560 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 418/854] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:55 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:55.656851 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aa1e197c-d1d5-438d-a5d0-ceb2b31bb8b5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:55.657486 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aa1e197c-d1d5-438d-a5d0-ceb2b31bb8b5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:55.668459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa1e197c-d1d5-438d-a5d0-ceb2b31bb8b5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:55.668926 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa1e197c-d1d5-438d-a5d0-ceb2b31bb8b5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:55.671433 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa1e197c-d1d5-438d-a5d0-ceb2b31bb8b5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:55.671874 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aa1e197c-d1d5-438d-a5d0-ceb2b31bb8b5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:55.911318 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aa1e197c-d1d5-438d-a5d0-ceb2b31bb8b5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:55.930564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:55.940934 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aa1e197c-d1d5-438d-a5d0-ceb2b31bb8b5 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1682 microversion: 2.1 time: 0.289407 Jul 07 07:26:55.951147 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 437/855] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:55 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1682 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:56.127401 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d38cab71-7bd3-4b93-acb3-2ded22cd8c72 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:56.132937 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d38cab71-7bd3-4b93-acb3-2ded22cd8c72 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:56.143582 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d38cab71-7bd3-4b93-acb3-2ded22cd8c72 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:56.146567 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d38cab71-7bd3-4b93-acb3-2ded22cd8c72 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:56.148427 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d38cab71-7bd3-4b93-acb3-2ded22cd8c72 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:56.149960 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d38cab71-7bd3-4b93-acb3-2ded22cd8c72 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:56.361209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-a1063788-4af2-40d4-ae5f-b6eb143f1d3b req-df9452f1-3dfa-4eb1-b9ff-7548971b6cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83944e7d-3750-4747-92ae-6a1f735c79fc", "name": "network-vif-plugged", "status": "completed", "tag": "19dfde08-41d9-41e9-b31b-405a6dc8008a"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:56.381095 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a1063788-4af2-40d4-ae5f-b6eb143f1d3b req-df9452f1-3dfa-4eb1-b9ff-7548971b6cdd service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:56.381583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-a1063788-4af2-40d4-ae5f-b6eb143f1d3b req-df9452f1-3dfa-4eb1-b9ff-7548971b6cdd service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:56.420617 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-a1063788-4af2-40d4-ae5f-b6eb143f1d3b req-df9452f1-3dfa-4eb1-b9ff-7548971b6cdd service nova] Creating event network-vif-plugged:19dfde08-41d9-41e9-b31b-405a6dc8008a for instance 83944e7d-3750-4747-92ae-6a1f735c79fc on hv-cinder-82660 Jul 07 07:26:56.436977 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-a1063788-4af2-40d4-ae5f-b6eb143f1d3b req-df9452f1-3dfa-4eb1-b9ff-7548971b6cdd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082471 Jul 07 07:26:56.438852 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 438/856] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:26:56.509161 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6096bedb-6b78-4b34-b414-d50780951531 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:56.509912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6096bedb-6b78-4b34-b414-d50780951531 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:56.517744 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6096bedb-6b78-4b34-b414-d50780951531 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:56.521198 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d38cab71-7bd3-4b93-acb3-2ded22cd8c72 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:56.521686 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6096bedb-6b78-4b34-b414-d50780951531 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:56.522502 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6096bedb-6b78-4b34-b414-d50780951531 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:56.523826 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6096bedb-6b78-4b34-b414-d50780951531 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:56.554942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d38cab71-7bd3-4b93-acb3-2ded22cd8c72 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.424408 Jul 07 07:26:56.567161 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 419/857] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:56 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:56.844482 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6096bedb-6b78-4b34-b414-d50780951531 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:56.859210 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6096bedb-6b78-4b34-b414-d50780951531 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:56.865789 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6096bedb-6b78-4b34-b414-d50780951531 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:56.868755 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6096bedb-6b78-4b34-b414-d50780951531 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1722 microversion: 2.20 time: 0.371459 Jul 07 07:26:56.869943 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 439/858] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:56 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:26:56.959110 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d9b4b51e-db4d-44c9-a068-db0b9d201dfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:56.960039 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d9b4b51e-db4d-44c9-a068-db0b9d201dfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:56.962272 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:26:56.969786 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9b4b51e-db4d-44c9-a068-db0b9d201dfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:56.971610 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9b4b51e-db4d-44c9-a068-db0b9d201dfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:56.972676 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9b4b51e-db4d-44c9-a068-db0b9d201dfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:56.973295 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9b4b51e-db4d-44c9-a068-db0b9d201dfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:57.209324 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d9b4b51e-db4d-44c9-a068-db0b9d201dfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:57.221866 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d9b4b51e-db4d-44c9-a068-db0b9d201dfa tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1682 microversion: 2.1 time: 0.266600 Jul 07 07:26:57.222462 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 420/859] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:56 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1682 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:57.575142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9aadaa18-c5a0-4cac-b849-3581a0ffd4c0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:57.576644 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9aadaa18-c5a0-4cac-b849-3581a0ffd4c0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:57.589803 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9aadaa18-c5a0-4cac-b849-3581a0ffd4c0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:57.593158 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9aadaa18-c5a0-4cac-b849-3581a0ffd4c0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:57.594205 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9aadaa18-c5a0-4cac-b849-3581a0ffd4c0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:57.594732 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9aadaa18-c5a0-4cac-b849-3581a0ffd4c0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:57.881482 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9aadaa18-c5a0-4cac-b849-3581a0ffd4c0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:57.890144 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d9b2dd1b-1feb-4b7c-a0fe-2e3aad71b881 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:57.890671 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9aadaa18-c5a0-4cac-b849-3581a0ffd4c0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1572 microversion: 2.1 time: 0.321211 Jul 07 07:26:57.890986 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d9b2dd1b-1feb-4b7c-a0fe-2e3aad71b881 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:57.892221 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 440/860] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:57 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1572 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:57.909522 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9b2dd1b-1feb-4b7c-a0fe-2e3aad71b881 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:57.910723 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9b2dd1b-1feb-4b7c-a0fe-2e3aad71b881 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:57.916682 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9b2dd1b-1feb-4b7c-a0fe-2e3aad71b881 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:57.919631 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d9b2dd1b-1feb-4b7c-a0fe-2e3aad71b881 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:58.226592 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d9b2dd1b-1feb-4b7c-a0fe-2e3aad71b881 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:58.237847 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d9b2dd1b-1feb-4b7c-a0fe-2e3aad71b881 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:58.243588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d9b2dd1b-1feb-4b7c-a0fe-2e3aad71b881 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:58.246832 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d532ad4d-ed6a-47b0-b8d3-e186e935d27a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:58.248236 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d532ad4d-ed6a-47b0-b8d3-e186e935d27a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:58.249541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d9b2dd1b-1feb-4b7c-a0fe-2e3aad71b881 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1722 microversion: 2.20 time: 0.363256 Jul 07 07:26:58.250508 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 421/861] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:57 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:26:58.272937 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d532ad4d-ed6a-47b0-b8d3-e186e935d27a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:58.273419 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d532ad4d-ed6a-47b0-b8d3-e186e935d27a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:58.274642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d532ad4d-ed6a-47b0-b8d3-e186e935d27a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:58.275095 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d532ad4d-ed6a-47b0-b8d3-e186e935d27a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:58.449290 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d532ad4d-ed6a-47b0-b8d3-e186e935d27a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:58.462368 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d532ad4d-ed6a-47b0-b8d3-e186e935d27a tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1615 microversion: 2.1 time: 0.221953 Jul 07 07:26:58.463567 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 441/862] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:58 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1615 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:58.502254 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-ce33ea8e-cba0-4edd-aae5-2ba6df836f8d req-8fbe2df9-333a-4c0f-8a88-787e341841c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb92117b-b521-46c1-bbef-7e97a808bab8", "name": "network-vif-unplugged", "status": "completed", "tag": "304ba8c6-1b84-41a1-aaca-b548534ce32b"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:58.526240 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ce33ea8e-cba0-4edd-aae5-2ba6df836f8d req-8fbe2df9-333a-4c0f-8a88-787e341841c2 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:58.526727 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ce33ea8e-cba0-4edd-aae5-2ba6df836f8d req-8fbe2df9-333a-4c0f-8a88-787e341841c2 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:58.551660 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-ce33ea8e-cba0-4edd-aae5-2ba6df836f8d req-8fbe2df9-333a-4c0f-8a88-787e341841c2 service nova] Creating event network-vif-unplugged:304ba8c6-1b84-41a1-aaca-b548534ce32b for instance eb92117b-b521-46c1-bbef-7e97a808bab8 on hv-cinder-82660 Jul 07 07:26:58.568318 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-ce33ea8e-cba0-4edd-aae5-2ba6df836f8d req-8fbe2df9-333a-4c0f-8a88-787e341841c2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068123 Jul 07 07:26:58.569817 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 422/863] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:58.848283 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-8595d4cd-9eaa-4959-ac90-6c4e42e9b9e6 req-d6612c8a-baa8-4a1e-8179-83335f559cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241d4c02-22a4-4c03-9cf1-9708f5de3922", "name": "network-vif-deleted", "tag": "889f78e4-6681-40f3-bf13-bcf02b894624"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:26:58.859808 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-8595d4cd-9eaa-4959-ac90-6c4e42e9b9e6 req-d6612c8a-baa8-4a1e-8179-83335f559cc4 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:58.860255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-8595d4cd-9eaa-4959-ac90-6c4e42e9b9e6 req-d6612c8a-baa8-4a1e-8179-83335f559cc4 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:58.886848 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-8595d4cd-9eaa-4959-ac90-6c4e42e9b9e6 req-d6612c8a-baa8-4a1e-8179-83335f559cc4 service nova] Creating event network-vif-deleted:889f78e4-6681-40f3-bf13-bcf02b894624 for instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 on hv-cinder-82660 Jul 07 07:26:58.893859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-8595d4cd-9eaa-4959-ac90-6c4e42e9b9e6 req-d6612c8a-baa8-4a1e-8179-83335f559cc4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055830 Jul 07 07:26:58.895151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 442/864] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:26:58.909047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-991456d3-6018-422a-b14c-da19d8cb97fe tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:58.909797 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-991456d3-6018-422a-b14c-da19d8cb97fe tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:58.925367 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-991456d3-6018-422a-b14c-da19d8cb97fe tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:58.925801 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-991456d3-6018-422a-b14c-da19d8cb97fe tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:58.926595 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-991456d3-6018-422a-b14c-da19d8cb97fe tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:58.927030 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-991456d3-6018-422a-b14c-da19d8cb97fe tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:59.112721 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-991456d3-6018-422a-b14c-da19d8cb97fe tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:59.123561 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-991456d3-6018-422a-b14c-da19d8cb97fe tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1559 microversion: 2.1 time: 0.220482 Jul 07 07:26:59.138153 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 423/865] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:58 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1559 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:59.274876 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aac1ae52-bc76-41b7-8dea-81494458ebfc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:59.281692 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aac1ae52-bc76-41b7-8dea-81494458ebfc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:59.304779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aac1ae52-bc76-41b7-8dea-81494458ebfc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:59.305586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aac1ae52-bc76-41b7-8dea-81494458ebfc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:59.308515 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aac1ae52-bc76-41b7-8dea-81494458ebfc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:59.309234 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aac1ae52-bc76-41b7-8dea-81494458ebfc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:59.480670 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7a9fdc15-17ee-43d7-9cc8-5239d1a2c085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:26:59.481317 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7a9fdc15-17ee-43d7-9cc8-5239d1a2c085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:26:59.492666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a9fdc15-17ee-43d7-9cc8-5239d1a2c085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:59.493128 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a9fdc15-17ee-43d7-9cc8-5239d1a2c085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:59.493971 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a9fdc15-17ee-43d7-9cc8-5239d1a2c085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:26:59.496952 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7a9fdc15-17ee-43d7-9cc8-5239d1a2c085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:26:59.624187 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7a9fdc15-17ee-43d7-9cc8-5239d1a2c085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:59.632107 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aac1ae52-bc76-41b7-8dea-81494458ebfc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:59.637657 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7a9fdc15-17ee-43d7-9cc8-5239d1a2c085 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1327 microversion: 2.1 time: 0.159393 Jul 07 07:26:59.638770 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 424/866] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:26:59 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1327 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:26:59.650057 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aac1ae52-bc76-41b7-8dea-81494458ebfc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:59.651565 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aac1ae52-bc76-41b7-8dea-81494458ebfc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:26:59.652824 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aac1ae52-bc76-41b7-8dea-81494458ebfc tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1722 microversion: 2.20 time: 0.388458 Jul 07 07:26:59.664655 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 443/867] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:26:59 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:00.655418 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c436ca2c-a5b7-455a-8152-7290e0550696 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:00.656037 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c436ca2c-a5b7-455a-8152-7290e0550696 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:00.662936 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c436ca2c-a5b7-455a-8152-7290e0550696 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:00.663431 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c436ca2c-a5b7-455a-8152-7290e0550696 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:00.664245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c436ca2c-a5b7-455a-8152-7290e0550696 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:00.664699 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c436ca2c-a5b7-455a-8152-7290e0550696 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:00.674741 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-09cd0a9f-bf63-4245-b24f-47b8c5bfa327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:00.676074 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-09cd0a9f-bf63-4245-b24f-47b8c5bfa327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:00.704011 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09cd0a9f-bf63-4245-b24f-47b8c5bfa327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:00.705927 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09cd0a9f-bf63-4245-b24f-47b8c5bfa327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:00.706993 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09cd0a9f-bf63-4245-b24f-47b8c5bfa327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:00.710838 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-09cd0a9f-bf63-4245-b24f-47b8c5bfa327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:00.739737 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c436ca2c-a5b7-455a-8152-7290e0550696 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58366850e234491cafe268bb56e9e3a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '883f7310b404427fa3ddda37a8d04acc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:00.749152 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c436ca2c-a5b7-455a-8152-7290e0550696 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 200 len: 1327 microversion: 2.1 time: 0.097549 Jul 07 07:27:00.758840 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 425/868] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:00 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:00.913561 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-09cd0a9f-bf63-4245-b24f-47b8c5bfa327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:00.921799 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-09cd0a9f-bf63-4245-b24f-47b8c5bfa327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:00.923303 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-09cd0a9f-bf63-4245-b24f-47b8c5bfa327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:00.924606 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-09cd0a9f-bf63-4245-b24f-47b8c5bfa327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1722 microversion: 2.20 time: 0.256569 Jul 07 07:27:00.925395 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 444/869] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:00 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:01.766807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8bbe7449-bb18-4062-873a-9ee695fbb7a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:01.767349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8bbe7449-bb18-4062-873a-9ee695fbb7a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:01.774822 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bbe7449-bb18-4062-873a-9ee695fbb7a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:01.775279 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bbe7449-bb18-4062-873a-9ee695fbb7a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:01.776053 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bbe7449-bb18-4062-873a-9ee695fbb7a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:01.776490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8bbe7449-bb18-4062-873a-9ee695fbb7a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:01.791015 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-8bbe7449-bb18-4062-873a-9ee695fbb7a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8bbe7449-bb18-4062-873a-9ee695fbb7a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 HTTP/1.1 Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:27:01.792713 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:01.794332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '241d4c02-22a4-4c03-9cf1-9708f5de3922'} Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:01.795145 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:01.796349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:01.797461 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8bbe7449-bb18-4062-873a-9ee695fbb7a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:01.797461 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8bbe7449-bb18-4062-873a-9ee695fbb7a7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 404 len: 111 microversion: 2.1 time: 0.031825 Jul 07 07:27:01.797461 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 426/870] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:01 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:01.803498 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5ac29ae5-4295-4234-8592-08a1c0120358 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '.version_select at 0x7fccf9fe8550>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:01.828865 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5ac29ae5-4295-4234-8592-08a1c0120358 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271886200" status: 202 len: 0 microversion: 2.1 time: 0.029104 Jul 07 07:27:01.829660 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 445/871] 10.222.0.62 () {58 vars in 1220 bytes} [Thu Jul 7 07:27:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1271886200 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:27:01.939892 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-645b61d9-99c0-4d81-b2cb-b736f196a95f tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccfa0774c0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:01.945261 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7435a195-96dd-4b92-b318-e4c80dd1943b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:01.947217 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7435a195-96dd-4b92-b318-e4c80dd1943b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:01.955992 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7435a195-96dd-4b92-b318-e4c80dd1943b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:01.956713 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7435a195-96dd-4b92-b318-e4c80dd1943b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:01.958247 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7435a195-96dd-4b92-b318-e4c80dd1943b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:01.958917 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7435a195-96dd-4b92-b318-e4c80dd1943b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:01.995638 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-645b61d9-99c0-4d81-b2cb-b736f196a95f tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/90e95696-05e6-428f-a26c-714f4beb9539" status: 200 len: 350 microversion: 2.1 time: 0.059867 Jul 07 07:27:01.996245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 427/872] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:27:01 2022] GET /compute/v2.1/os-volumes/90e95696-05e6-428f-a26c-714f4beb9539 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:02.492675 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7435a195-96dd-4b92-b318-e4c80dd1943b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:02.501257 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7435a195-96dd-4b92-b318-e4c80dd1943b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:02.502802 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7435a195-96dd-4b92-b318-e4c80dd1943b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:02.504482 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7435a195-96dd-4b92-b318-e4c80dd1943b tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1665 microversion: 2.20 time: 0.564466 Jul 07 07:27:02.504654 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 446/873] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:01 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1665 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:02.522377 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-07bf8565-b7dd-4fd6-96b2-1972e5aa5ef9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2d900b5-5285-4973-aed7-027c51f63e11"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:27:02.523491 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-07bf8565-b7dd-4fd6-96b2-1972e5aa5ef9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:02.530931 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07bf8565-b7dd-4fd6-96b2-1972e5aa5ef9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:02.531381 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07bf8565-b7dd-4fd6-96b2-1972e5aa5ef9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:02.532162 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07bf8565-b7dd-4fd6-96b2-1972e5aa5ef9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:02.532600 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-07bf8565-b7dd-4fd6-96b2-1972e5aa5ef9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:02.859691 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-07bf8565-b7dd-4fd6-96b2-1972e5aa5ef9 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "POST /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341453 Jul 07 07:27:02.865408 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 428/874] 10.222.0.62 () {62 vars in 1363 bytes} [Thu Jul 7 07:27:02 2022] POST /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/os-volume_attachments => generated 188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 07 07:27:02.976698 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5df53857-ad71-4fe9-a18c-e99daaa114d6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:02.977212 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5df53857-ad71-4fe9-a18c-e99daaa114d6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:02.984819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5df53857-ad71-4fe9-a18c-e99daaa114d6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:02.985366 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5df53857-ad71-4fe9-a18c-e99daaa114d6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:02.986222 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5df53857-ad71-4fe9-a18c-e99daaa114d6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:02.986730 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5df53857-ad71-4fe9-a18c-e99daaa114d6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:03.265708 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5df53857-ad71-4fe9-a18c-e99daaa114d6 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/os-volume_attachments/a2d900b5-5285-4973-aed7-027c51f63e11" status: 202 len: 0 microversion: 2.20 time: 0.293017 Jul 07 07:27:03.266307 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 447/875] 10.222.0.62 () {60 vars in 1456 bytes} [Thu Jul 7 07:27:02 2022] DELETE /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/os-volume_attachments/a2d900b5-5285-4973-aed7-027c51f63e11 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:27:03.321857 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-293426c8-1877-409d-813a-34f973921f46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:27:03.326437 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-293426c8-1877-409d-813a-34f973921f46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:03.329357 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-293426c8-1877-409d-813a-34f973921f46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:03.329811 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-293426c8-1877-409d-813a-34f973921f46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:03.330598 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-293426c8-1877-409d-813a-34f973921f46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:03.331036 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-293426c8-1877-409d-813a-34f973921f46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:03.363174 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a5f71c6a-b0dc-467d-a470-d3d59df20962 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccf9fe8820>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:03.414873 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a5f71c6a-b0dc-467d-a470-d3d59df20962 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/9ec45cc6-24b7-426a-b534-5abd5f3f47b0" status: 200 len: 351 microversion: 2.1 time: 0.055859 Jul 07 07:27:03.415611 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 448/876] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:27:03 2022] GET /compute/v2.1/os-volumes/9ec45cc6-24b7-426a-b534-5abd5f3f47b0 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:27:03.415986 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-293426c8-1877-409d-813a-34f973921f46 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "POST /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/action" status: 202 len: 0 microversion: 2.20 time: 0.097911 Jul 07 07:27:03.416747 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 429/877] 10.222.0.62 () {62 vars in 1318 bytes} [Thu Jul 7 07:27:03 2022] POST /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:27:03.426672 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-faebda28-77ae-40ef-8f71-82b1665d9f24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:03.427593 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-faebda28-77ae-40ef-8f71-82b1665d9f24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:03.435514 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-faebda28-77ae-40ef-8f71-82b1665d9f24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:03.436115 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-faebda28-77ae-40ef-8f71-82b1665d9f24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:03.437006 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-faebda28-77ae-40ef-8f71-82b1665d9f24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:03.437702 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-faebda28-77ae-40ef-8f71-82b1665d9f24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:03.585541 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-faebda28-77ae-40ef-8f71-82b1665d9f24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:03.605247 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-faebda28-77ae-40ef-8f71-82b1665d9f24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:03.607029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-faebda28-77ae-40ef-8f71-82b1665d9f24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:03.608365 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-faebda28-77ae-40ef-8f71-82b1665d9f24 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1673 microversion: 2.20 time: 0.186174 Jul 07 07:27:03.609482 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 449/878] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:03 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:27:03.966889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-321364e7-9379-4c83-a95f-f43d05ea7b88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:03.968050 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-321364e7-9379-4c83-a95f-f43d05ea7b88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:03.977509 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-321364e7-9379-4c83-a95f-f43d05ea7b88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:03.978267 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-321364e7-9379-4c83-a95f-f43d05ea7b88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:03.979053 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-321364e7-9379-4c83-a95f-f43d05ea7b88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:03.979471 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-321364e7-9379-4c83-a95f-f43d05ea7b88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:03.993833 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-321364e7-9379-4c83-a95f-f43d05ea7b88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-321364e7-9379-4c83-a95f-f43d05ea7b88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 HTTP/1.1 Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:27:03.995620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:03.996922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '241d4c02-22a4-4c03-9cf1-9708f5de3922'} Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:03.997863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:03.999088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:04.000322 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-321364e7-9379-4c83-a95f-f43d05ea7b88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:04.000322 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-321364e7-9379-4c83-a95f-f43d05ea7b88 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 404 len: 111 microversion: 2.1 time: 0.035244 Jul 07 07:27:04.000322 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 430/879] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:27:03 2022] DELETE /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:04.005709 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-66b22a86-cacf-40b2-bdbb-f1363780df38 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:04.006296 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-66b22a86-cacf-40b2-bdbb-f1363780df38 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 241d4c02-22a4-4c03-9cf1-9708f5de3922] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:04.013706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-66b22a86-cacf-40b2-bdbb-f1363780df38 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:04.014153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-66b22a86-cacf-40b2-bdbb-f1363780df38 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:04.015294 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-66b22a86-cacf-40b2-bdbb-f1363780df38 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:04.015892 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-66b22a86-cacf-40b2-bdbb-f1363780df38 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:04.039774 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-66b22a86-cacf-40b2-bdbb-f1363780df38 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-66b22a86-cacf-40b2-bdbb-f1363780df38 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 HTTP/1.1 Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:27:04.042012 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:04.043757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '241d4c02-22a4-4c03-9cf1-9708f5de3922'} Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:04.044638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. Jul 07 07:27:04.047893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:04.048981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-66b22a86-cacf-40b2-bdbb-f1363780df38 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance 241d4c02-22a4-4c03-9cf1-9708f5de3922 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:04.048981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-66b22a86-cacf-40b2-bdbb-f1363780df38 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922" status: 404 len: 111 microversion: 2.1 time: 0.043470 Jul 07 07:27:04.048981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 450/880] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:04 2022] GET /compute/v2.1/servers/241d4c02-22a4-4c03-9cf1-9708f5de3922 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 07:27:04.628495 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-32d2d8d5-5bff-4f36-8349-56d1364e57d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:04.629610 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-32d2d8d5-5bff-4f36-8349-56d1364e57d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:04.636246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-32d2d8d5-5bff-4f36-8349-56d1364e57d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:04.636246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-32d2d8d5-5bff-4f36-8349-56d1364e57d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:04.637251 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-32d2d8d5-5bff-4f36-8349-56d1364e57d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:04.637572 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-32d2d8d5-5bff-4f36-8349-56d1364e57d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:04.656948 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:04.782974 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-32d2d8d5-5bff-4f36-8349-56d1364e57d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:04.790402 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-87f5dba1-ede8-434e-b1f1-5415a15f7b10 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccfa403ca0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:04.792703 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-32d2d8d5-5bff-4f36-8349-56d1364e57d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:04.794285 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-32d2d8d5-5bff-4f36-8349-56d1364e57d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:04.795460 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-32d2d8d5-5bff-4f36-8349-56d1364e57d0 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.171101 Jul 07 07:27:04.796073 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 431/881] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:04 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:04.844084 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-87f5dba1-ede8-434e-b1f1-5415a15f7b10 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/79be8a03-7040-4bc2-b5f6-e1813c766fbc" status: 200 len: 350 microversion: 2.1 time: 0.057529 Jul 07 07:27:04.844725 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 451/882] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:27:04 2022] GET /compute/v2.1/os-volumes/79be8a03-7040-4bc2-b5f6-e1813c766fbc => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:27:04.858584 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ad062e00-6773-4016-a072-60895fad7f85 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccfa02fe50>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:04.952152 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ad062e00-6773-4016-a072-60895fad7f85 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099908 Jul 07 07:27:04.952734 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 432/883] 10.222.0.62 () {58 vars in 1133 bytes} [Thu Jul 7 07:27:04 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:04.965260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-131506a0-3b12-4fdb-8b7b-15c76dba1901 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccfa2253a0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.049417 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-131506a0-3b12-4fdb-8b7b-15c76dba1901 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088028 Jul 07 07:27:05.050177 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 452/884] 10.222.0.62 () {58 vars in 1148 bytes} [Thu Jul 7 07:27:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:05.062347 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-55959306-ea67-4af5-a581-6dbc3679bc46 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccfa03f310>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.153042 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-55959306-ea67-4af5-a581-6dbc3679bc46 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095004 Jul 07 07:27:05.153752 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 433/885] 10.222.0.62 () {58 vars in 1133 bytes} [Thu Jul 7 07:27:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:05.165781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-495c8227-5cb6-4da3-a66e-4a3deee989ee tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccfa1f8670>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.237042 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-01d83699-c700-473c-aeee-5af046fd9028 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.237783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-01d83699-c700-473c-aeee-5af046fd9028 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:05.247662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-01d83699-c700-473c-aeee-5af046fd9028 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:05.248316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-01d83699-c700-473c-aeee-5af046fd9028 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:05.249298 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-01d83699-c700-473c-aeee-5af046fd9028 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:05.249878 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-01d83699-c700-473c-aeee-5af046fd9028 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:05.255328 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-495c8227-5cb6-4da3-a66e-4a3deee989ee tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093918 Jul 07 07:27:05.256035 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 453/886] 10.222.0.62 () {58 vars in 1166 bytes} [Thu Jul 7 07:27:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:05.265544 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-01d83699-c700-473c-aeee-5af046fd9028 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-01d83699-c700-473c-aeee-5af046fd9028 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 HTTP/1.1 Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:27:05.267363 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:27:05.268666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '63316553-0499-415e-82f5-27b303818561'} Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:05.269439 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:27:05.270868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.272267 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-01d83699-c700-473c-aeee-5af046fd9028 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:05.272486 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e2c9b270-c52a-4114-bff3-5fcc6bd208be tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccfa1f88b0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.272897 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-01d83699-c700-473c-aeee-5af046fd9028 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 404 len: 111 microversion: 2.1 time: 0.036569 Jul 07 07:27:05.272897 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 434/887] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:27:05 2022] DELETE /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:05.277015 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-74f927b1-ba79-4d65-93c7-afddc8fb8014 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.277896 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-74f927b1-ba79-4d65-93c7-afddc8fb8014 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 63316553-0499-415e-82f5-27b303818561] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:05.286462 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-74f927b1-ba79-4d65-93c7-afddc8fb8014 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:05.287038 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-74f927b1-ba79-4d65-93c7-afddc8fb8014 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:05.287877 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-74f927b1-ba79-4d65-93c7-afddc8fb8014 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:05.288377 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-74f927b1-ba79-4d65-93c7-afddc8fb8014 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:05.302974 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-74f927b1-ba79-4d65-93c7-afddc8fb8014 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-74f927b1-ba79-4d65-93c7-afddc8fb8014 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 HTTP/1.1 Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:27:05.304580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:27:05.306227 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '63316553-0499-415e-82f5-27b303818561'} Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:05.307103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. Jul 07 07:27:05.309680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.311184 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-74f927b1-ba79-4d65-93c7-afddc8fb8014 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance 63316553-0499-415e-82f5-27b303818561 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:05.311184 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-74f927b1-ba79-4d65-93c7-afddc8fb8014 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561" status: 404 len: 111 microversion: 2.1 time: 0.034319 Jul 07 07:27:05.311184 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 435/888] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:05 2022] GET /compute/v2.1/servers/63316553-0499-415e-82f5-27b303818561 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:05.317495 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-42e51e48-520f-47c1-a257-007053a27ab7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.317721 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-42e51e48-520f-47c1-a257-007053a27ab7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:05.324391 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42e51e48-520f-47c1-a257-007053a27ab7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:05.324884 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42e51e48-520f-47c1-a257-007053a27ab7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:05.325676 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42e51e48-520f-47c1-a257-007053a27ab7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:05.326125 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-42e51e48-520f-47c1-a257-007053a27ab7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:05.340449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-42e51e48-520f-47c1-a257-007053a27ab7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-42e51e48-520f-47c1-a257-007053a27ab7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 HTTP/1.1 Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:27:05.342108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:27:05.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'f8e7489d-0481-4cfe-8e7d-4d9bd447f492'} Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:05.344818 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:27:05.346068 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.347279 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-42e51e48-520f-47c1-a257-007053a27ab7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:05.347279 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-42e51e48-520f-47c1-a257-007053a27ab7 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 404 len: 111 microversion: 2.1 time: 0.030332 Jul 07 07:27:05.347279 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 436/889] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:27:05 2022] DELETE /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:05.352040 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e5b0c2f3-175a-46bc-a934-8a5120ca7dbb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.352656 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e5b0c2f3-175a-46bc-a934-8a5120ca7dbb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: f8e7489d-0481-4cfe-8e7d-4d9bd447f492] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:05.359461 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5b0c2f3-175a-46bc-a934-8a5120ca7dbb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:05.359927 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5b0c2f3-175a-46bc-a934-8a5120ca7dbb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:05.360699 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5b0c2f3-175a-46bc-a934-8a5120ca7dbb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:05.361127 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e5b0c2f3-175a-46bc-a934-8a5120ca7dbb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:05.376849 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e2c9b270-c52a-4114-bff3-5fcc6bd208be tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.112438 Jul 07 07:27:05.377750 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 454/890] 10.222.0.62 () {58 vars in 1169 bytes} [Thu Jul 7 07:27:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:05.386871 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-e5b0c2f3-175a-46bc-a934-8a5120ca7dbb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e5b0c2f3-175a-46bc-a934-8a5120ca7dbb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 HTTP/1.1 Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:27:05.388942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:27:05.390315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'f8e7489d-0481-4cfe-8e7d-4d9bd447f492'} Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:05.391182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. Jul 07 07:27:05.393190 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:05.394431 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e5b0c2f3-175a-46bc-a934-8a5120ca7dbb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance f8e7489d-0481-4cfe-8e7d-4d9bd447f492 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:05.394431 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e5b0c2f3-175a-46bc-a934-8a5120ca7dbb tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492" status: 404 len: 111 microversion: 2.1 time: 0.042191 Jul 07 07:27:05.394431 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 437/891] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:05 2022] GET /compute/v2.1/servers/f8e7489d-0481-4cfe-8e7d-4d9bd447f492 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:05.403338 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-08f08c10-dbe0-4989-bd44-55cf5551d854 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccfa403d30>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.489737 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-08f08c10-dbe0-4989-bd44-55cf5551d854 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.102936 Jul 07 07:27:05.498860 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 455/892] 10.222.0.62 () {58 vars in 1154 bytes} [Thu Jul 7 07:27:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:05.504651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-49a9abca-b7d3-4922-b5a4-44209d3429f8 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccfa02f940>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.618692 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-49a9abca-b7d3-4922-b5a4-44209d3429f8 tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.118565 Jul 07 07:27:05.619579 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 438/893] 10.222.0.62 () {58 vars in 1187 bytes} [Thu Jul 7 07:27:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:05.631471 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-93575790-31b0-471c-b409-88382c45fe5e tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] Calling method '.version_select at 0x7fccfa206280>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.723404 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-93575790-31b0-471c-b409-88382c45fe5e tempest-VolumesTestJSON-1842545207 tempest-VolumesTestJSON-1842545207-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.095701 Jul 07 07:27:05.725253 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 456/894] 10.222.0.62 () {58 vars in 1154 bytes} [Thu Jul 7 07:27:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:05.819733 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-6eeb442f-02cb-405f-9675-591fde652d78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:05.819733 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-6eeb442f-02cb-405f-9675-591fde652d78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:05.836054 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6eeb442f-02cb-405f-9675-591fde652d78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:05.836572 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6eeb442f-02cb-405f-9675-591fde652d78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:05.840259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6eeb442f-02cb-405f-9675-591fde652d78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:05.842053 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-6eeb442f-02cb-405f-9675-591fde652d78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:06.063503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6eeb442f-02cb-405f-9675-591fde652d78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:06.074164 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6eeb442f-02cb-405f-9675-591fde652d78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:06.075691 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-6eeb442f-02cb-405f-9675-591fde652d78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:06.077866 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-6eeb442f-02cb-405f-9675-591fde652d78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.266172 Jul 07 07:27:06.079657 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 439/895] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:05 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:06.579274 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-432dc1ab-4346-42ad-bdbd-38afa651d578 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:06.580487 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-432dc1ab-4346-42ad-bdbd-38afa651d578 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:06.588692 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-432dc1ab-4346-42ad-bdbd-38afa651d578 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:06.589380 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-432dc1ab-4346-42ad-bdbd-38afa651d578 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:06.590297 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-432dc1ab-4346-42ad-bdbd-38afa651d578 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:06.590754 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-432dc1ab-4346-42ad-bdbd-38afa651d578 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:06.605875 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-432dc1ab-4346-42ad-bdbd-38afa651d578 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-432dc1ab-4346-42ad-bdbd-38afa651d578 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: DELETE /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c HTTP/1.1 Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:27:06.607488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:27:06.609097 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '9f327dd6-9e19-4aa6-bdb1-7706c651c08c'} Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:06.613563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:27:06.615119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:06.616592 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-432dc1ab-4346-42ad-bdbd-38afa651d578 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:06.616592 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-432dc1ab-4346-42ad-bdbd-38afa651d578 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "DELETE /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 404 len: 111 microversion: 2.1 time: 0.033408 Jul 07 07:27:06.616592 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 457/896] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:27:06 2022] DELETE /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:06.622105 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e2cb6aa6-5ef6-43eb-b21d-d4dd369960c2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:06.622829 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e2cb6aa6-5ef6-43eb-b21d-d4dd369960c2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] [instance: 9f327dd6-9e19-4aa6-bdb1-7706c651c08c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:06.632688 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2cb6aa6-5ef6-43eb-b21d-d4dd369960c2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:06.633283 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2cb6aa6-5ef6-43eb-b21d-d4dd369960c2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:06.634159 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2cb6aa6-5ef6-43eb-b21d-d4dd369960c2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:06.634663 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e2cb6aa6-5ef6-43eb-b21d-d4dd369960c2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:06.649551 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-e2cb6aa6-5ef6-43eb-b21d-d4dd369960c2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] HTTP exception thrown: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e2cb6aa6-5ef6-43eb-b21d-d4dd369960c2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Request method failure captured: Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c HTTP/1.1 Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok4Az65uXKlgZ4LmL25wpzTdgpoSy2XM0DsmX-ywyEPJmSSDez0mflgOQ_Zlmeai_jlY_hzP5RvYNWIiUg8DGDkv5InmUOMnPi2zFYPqCqBQ6zdYC0hTfLPaJ1VE2K_hIsP2JCbvntH5dpurZ_92qp7F_lt3TDMoi5CpVpmRuwfTE4 Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:27:06.651116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/883f7310b404427fa3ddda37a8d04acc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 883f7310b404427fa3ddda37a8d04acc Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2054506251 Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 58366850e234491cafe268bb56e9e3a1 Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeNegativeTest-2054506251-project Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:27:06.652735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '9f327dd6-9e19-4aa6-bdb1-7706c651c08c'} Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:06.653651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. Jul 07 07:27:06.655193 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:06.656524 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e2cb6aa6-5ef6-43eb-b21d-d4dd369960c2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] Returning 404 to user: Instance 9f327dd6-9e19-4aa6-bdb1-7706c651c08c could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:06.656524 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e2cb6aa6-5ef6-43eb-b21d-d4dd369960c2 tempest-AttachVolumeNegativeTest-2054506251 tempest-AttachVolumeNegativeTest-2054506251-project] 10.222.0.62 "GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c" status: 404 len: 111 microversion: 2.1 time: 0.035934 Jul 07 07:27:06.656524 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 440/897] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:06 2022] GET /compute/v2.1/servers/9f327dd6-9e19-4aa6-bdb1-7706c651c08c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:07.098464 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-04bb90d2-ffd7-405f-b346-92ee6b76edc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:07.099144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-04bb90d2-ffd7-405f-b346-92ee6b76edc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:07.109651 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04bb90d2-ffd7-405f-b346-92ee6b76edc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:07.110188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04bb90d2-ffd7-405f-b346-92ee6b76edc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:07.112859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04bb90d2-ffd7-405f-b346-92ee6b76edc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:07.113348 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-04bb90d2-ffd7-405f-b346-92ee6b76edc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:07.312398 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-04bb90d2-ffd7-405f-b346-92ee6b76edc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:07.325631 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-04bb90d2-ffd7-405f-b346-92ee6b76edc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:07.328911 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-04bb90d2-ffd7-405f-b346-92ee6b76edc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:07.330683 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-04bb90d2-ffd7-405f-b346-92ee6b76edc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.237143 Jul 07 07:27:07.331652 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 458/898] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:07 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:08.351226 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a2935542-0ce9-411a-a47c-e0c1ec707327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:08.352882 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-a2935542-0ce9-411a-a47c-e0c1ec707327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:08.376633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2935542-0ce9-411a-a47c-e0c1ec707327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:08.379301 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2935542-0ce9-411a-a47c-e0c1ec707327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:08.380210 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2935542-0ce9-411a-a47c-e0c1ec707327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:08.380659 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-a2935542-0ce9-411a-a47c-e0c1ec707327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:08.561454 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a2935542-0ce9-411a-a47c-e0c1ec707327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:08.569758 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a2935542-0ce9-411a-a47c-e0c1ec707327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:08.575253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-a2935542-0ce9-411a-a47c-e0c1ec707327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:08.576764 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a2935542-0ce9-411a-a47c-e0c1ec707327 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.229676 Jul 07 07:27:08.577573 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 441/899] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:08 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:27:09.596626 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-eb88f4e2-cb67-41bb-b069-a73d446d2057 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:09.597856 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-eb88f4e2-cb67-41bb-b069-a73d446d2057 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:09.606158 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb88f4e2-cb67-41bb-b069-a73d446d2057 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:09.607055 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb88f4e2-cb67-41bb-b069-a73d446d2057 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:09.607861 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb88f4e2-cb67-41bb-b069-a73d446d2057 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:09.608296 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-eb88f4e2-cb67-41bb-b069-a73d446d2057 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:09.932862 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eb88f4e2-cb67-41bb-b069-a73d446d2057 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:09.951736 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eb88f4e2-cb67-41bb-b069-a73d446d2057 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:09.953963 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-eb88f4e2-cb67-41bb-b069-a73d446d2057 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:09.955442 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-eb88f4e2-cb67-41bb-b069-a73d446d2057 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.363739 Jul 07 07:27:09.958457 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 459/900] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:09 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:27:10.978242 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-bda5ebbd-996c-4218-a03a-86e7ed6b397e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:10.980204 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-bda5ebbd-996c-4218-a03a-86e7ed6b397e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:10.991220 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bda5ebbd-996c-4218-a03a-86e7ed6b397e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:10.991998 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bda5ebbd-996c-4218-a03a-86e7ed6b397e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:10.993076 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bda5ebbd-996c-4218-a03a-86e7ed6b397e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:10.994143 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-bda5ebbd-996c-4218-a03a-86e7ed6b397e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:11.213512 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bda5ebbd-996c-4218-a03a-86e7ed6b397e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:11.223006 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bda5ebbd-996c-4218-a03a-86e7ed6b397e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:11.224729 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-bda5ebbd-996c-4218-a03a-86e7ed6b397e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:11.226240 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-bda5ebbd-996c-4218-a03a-86e7ed6b397e tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.254872 Jul 07 07:27:11.226912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 442/901] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:10 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:12.254251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-57c8cdd8-c61d-43ef-9882-d1bdbf221f8c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:12.255343 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-57c8cdd8-c61d-43ef-9882-d1bdbf221f8c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:12.268846 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57c8cdd8-c61d-43ef-9882-d1bdbf221f8c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:12.269340 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57c8cdd8-c61d-43ef-9882-d1bdbf221f8c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:12.270134 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57c8cdd8-c61d-43ef-9882-d1bdbf221f8c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:12.270570 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57c8cdd8-c61d-43ef-9882-d1bdbf221f8c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:12.476884 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-57c8cdd8-c61d-43ef-9882-d1bdbf221f8c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:12.491304 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-57c8cdd8-c61d-43ef-9882-d1bdbf221f8c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:12.493405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-57c8cdd8-c61d-43ef-9882-d1bdbf221f8c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:12.494802 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-57c8cdd8-c61d-43ef-9882-d1bdbf221f8c tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.253779 Jul 07 07:27:12.496168 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 460/902] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:12 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:13.112330 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-13c950ae-5ac0-45a7-81d2-038fc52204be tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Action: 'create', calling method: .version_select at 0x7fccfa03a550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-892275070"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:27:13.521020 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-15af1bb6-edaf-4b13-b736-5ce68e0d6fee tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:13.521933 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-15af1bb6-edaf-4b13-b736-5ce68e0d6fee tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:13.533094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-15af1bb6-edaf-4b13-b736-5ce68e0d6fee tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:13.533878 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-15af1bb6-edaf-4b13-b736-5ce68e0d6fee tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:13.535259 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-15af1bb6-edaf-4b13-b736-5ce68e0d6fee tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:13.535899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-15af1bb6-edaf-4b13-b736-5ce68e0d6fee tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:13.737847 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-13c950ae-5ac0-45a7-81d2-038fc52204be tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.038443 Jul 07 07:27:13.744798 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 443/903] 10.222.0.62 () {60 vars in 1154 bytes} [Thu Jul 7 07:27:12 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1046 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 07 07:27:13.751433 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9fbdbc76-7bd2-4e64-9bb4-d8dd0803536d tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccf9fcd820>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:13.755384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-15af1bb6-edaf-4b13-b736-5ce68e0d6fee tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:13.764412 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-15af1bb6-edaf-4b13-b736-5ce68e0d6fee tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:13.766326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-15af1bb6-edaf-4b13-b736-5ce68e0d6fee tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:13.807353 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-15af1bb6-edaf-4b13-b736-5ce68e0d6fee tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.291952 Jul 07 07:27:13.808562 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 461/904] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:13 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:27:13.870310 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9fbdbc76-7bd2-4e64-9bb4-d8dd0803536d tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21" status: 200 len: 344 microversion: 2.1 time: 0.124083 Jul 07 07:27:13.870972 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 444/905] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:27:13 2022] GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21 => generated 344 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:14.827480 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8e881659-c93d-4227-9114-dfac6f2ac204 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:14.828169 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-8e881659-c93d-4227-9114-dfac6f2ac204 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:14.834991 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e881659-c93d-4227-9114-dfac6f2ac204 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:14.835659 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e881659-c93d-4227-9114-dfac6f2ac204 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:14.836460 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e881659-c93d-4227-9114-dfac6f2ac204 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:14.836932 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-8e881659-c93d-4227-9114-dfac6f2ac204 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:14.882791 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4106fa7f-6efa-420f-a8ab-82749acf70a2 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa03ac10>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:14.954361 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4106fa7f-6efa-420f-a8ab-82749acf70a2 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21" status: 200 len: 345 microversion: 2.1 time: 0.075507 Jul 07 07:27:14.961796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 445/906] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:27:14 2022] GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:14.967394 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-69c49f1f-5314-49f2-b343-ba4c8225b304 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Action: 'create', calling method: .version_select at 0x7fccfa02fca0>, body: {"snapshot": {"volume_id": "0eef4da7-af46-4a70-8464-6d1538f36e21", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1687376648"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:27:15.009867 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8e881659-c93d-4227-9114-dfac6f2ac204 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:15.012809 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:15.021189 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8e881659-c93d-4227-9114-dfac6f2ac204 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:15.023723 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-8e881659-c93d-4227-9114-dfac6f2ac204 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:15.025115 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8e881659-c93d-4227-9114-dfac6f2ac204 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.202695 Jul 07 07:27:15.026930 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 462/907] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:14 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:27:15.204746 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-69c49f1f-5314-49f2-b343-ba4c8225b304 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.241579 Jul 07 07:27:15.205520 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 446/908] 10.222.0.62 () {60 vars in 1161 bytes} [Thu Jul 7 07:27:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:15.216487 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bb44af5a-36d1-4b4c-b336-84014492e874 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa2a6040>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:15.252395 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bb44af5a-36d1-4b4c-b336-84014492e874 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069" status: 200 len: 287 microversion: 2.1 time: 0.040140 Jul 07 07:27:15.253086 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 463/909] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Jul 7 07:27:15 2022] GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:15.263590 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-a3908b8e-06c7-4fd8-a0e0-0ef9460e2fa7 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa077430>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:15.295447 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-a3908b8e-06c7-4fd8-a0e0-0ef9460e2fa7 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035846 Jul 07 07:27:15.296206 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 447/910] 10.222.0.62 () {58 vars in 1139 bytes} [Thu Jul 7 07:27:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:15.306614 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dbecb7a3-4bb6-4ddc-b2f4-1cb4812ce528 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa5b8e50>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:15.339360 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dbecb7a3-4bb6-4ddc-b2f4-1cb4812ce528 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069" status: 200 len: 287 microversion: 2.1 time: 0.036586 Jul 07 07:27:15.340015 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 464/911] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Jul 7 07:27:15 2022] GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:27:16.046255 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8764a325-47d0-441d-a22b-be284f2dee55 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:16.046846 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8764a325-47d0-441d-a22b-be284f2dee55 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:16.054525 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8764a325-47d0-441d-a22b-be284f2dee55 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:16.055032 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8764a325-47d0-441d-a22b-be284f2dee55 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:16.055911 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8764a325-47d0-441d-a22b-be284f2dee55 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:16.056429 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8764a325-47d0-441d-a22b-be284f2dee55 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:16.202414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8764a325-47d0-441d-a22b-be284f2dee55 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:16.210503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8764a325-47d0-441d-a22b-be284f2dee55 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:16.212315 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8764a325-47d0-441d-a22b-be284f2dee55 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:16.213516 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8764a325-47d0-441d-a22b-be284f2dee55 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.172451 Jul 07 07:27:16.214159 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 448/912] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:16 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:16.352592 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c11b8855-f94f-4d00-8481-823f49b0af37 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccf9f120d0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:16.383923 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c11b8855-f94f-4d00-8481-823f49b0af37 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069" status: 200 len: 287 microversion: 2.1 time: 0.035215 Jul 07 07:27:16.384789 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 465/913] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Jul 7 07:27:16 2022] GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:17.232327 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-8794e610-1d2d-489f-b554-99b6eae55243 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:17.232922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-8794e610-1d2d-489f-b554-99b6eae55243 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:17.240081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8794e610-1d2d-489f-b554-99b6eae55243 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:17.240578 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8794e610-1d2d-489f-b554-99b6eae55243 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:17.241489 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8794e610-1d2d-489f-b554-99b6eae55243 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:17.241911 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-8794e610-1d2d-489f-b554-99b6eae55243 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:17.386662 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8794e610-1d2d-489f-b554-99b6eae55243 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:17.395448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8794e610-1d2d-489f-b554-99b6eae55243 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:17.396957 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-8794e610-1d2d-489f-b554-99b6eae55243 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:17.398167 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-8794e610-1d2d-489f-b554-99b6eae55243 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.169832 Jul 07 07:27:17.398892 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 449/914] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:17 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:17.399248 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8773f6d7-9daa-41fc-bd1d-3847e638085e tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccf9f38ee0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:17.430478 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8773f6d7-9daa-41fc-bd1d-3847e638085e tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069" status: 200 len: 287 microversion: 2.1 time: 0.035888 Jul 07 07:27:17.431066 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 466/915] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Jul 7 07:27:17 2022] GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:18.418574 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-888b943f-f8a2-4cc1-aefd-aa7dbb25cba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:18.419174 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-888b943f-f8a2-4cc1-aefd-aa7dbb25cba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:18.426753 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-888b943f-f8a2-4cc1-aefd-aa7dbb25cba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:18.427246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-888b943f-f8a2-4cc1-aefd-aa7dbb25cba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:18.428016 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-888b943f-f8a2-4cc1-aefd-aa7dbb25cba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:18.428455 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-888b943f-f8a2-4cc1-aefd-aa7dbb25cba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:18.443356 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-55fbcba5-28f7-489c-b0f7-beb98e68102d tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccf9f12d30>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:18.474241 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-55fbcba5-28f7-489c-b0f7-beb98e68102d tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069" status: 200 len: 287 microversion: 2.1 time: 0.035332 Jul 07 07:27:18.474821 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 467/916] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Jul 7 07:27:18 2022] GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:18.566492 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-888b943f-f8a2-4cc1-aefd-aa7dbb25cba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:18.574580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-888b943f-f8a2-4cc1-aefd-aa7dbb25cba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:18.576272 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-888b943f-f8a2-4cc1-aefd-aa7dbb25cba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:18.577473 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-888b943f-f8a2-4cc1-aefd-aa7dbb25cba7 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.164634 Jul 07 07:27:18.578017 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 450/917] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:18 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:19.486973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d0b052aa-d79b-4fbd-a6cb-d8e2080a6b5c tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa24b790>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:19.520798 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d0b052aa-d79b-4fbd-a6cb-d8e2080a6b5c tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069" status: 200 len: 288 microversion: 2.1 time: 0.038236 Jul 07 07:27:19.521409 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 468/918] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Jul 7 07:27:19 2022] GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:19.532378 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2499d99d-b7d2-41f6-aeac-6322c11e8854 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccf9fd83a0>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:19.599441 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-83cd8aa4-5317-4877-b71f-2e01798c4dc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:19.600100 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-83cd8aa4-5317-4877-b71f-2e01798c4dc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:19.602656 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:19.602893 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2499d99d-b7d2-41f6-aeac-6322c11e8854 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069" status: 202 len: 0 microversion: 2.1 time: 0.074414 Jul 07 07:27:19.604206 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 451/919] 10.222.0.62 () {58 vars in 1253 bytes} [Thu Jul 7 07:27:19 2022] DELETE /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:27:19.610319 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83cd8aa4-5317-4877-b71f-2e01798c4dc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:19.611043 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83cd8aa4-5317-4877-b71f-2e01798c4dc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:19.612030 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83cd8aa4-5317-4877-b71f-2e01798c4dc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:19.612583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-83cd8aa4-5317-4877-b71f-2e01798c4dc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:19.614397 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7ce168d2-dd5d-4030-b3d9-0b32930234a0 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccf9fcdb80>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:19.645576 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7ce168d2-dd5d-4030-b3d9-0b32930234a0 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069" status: 200 len: 287 microversion: 2.1 time: 0.034848 Jul 07 07:27:19.646428 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 452/920] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Jul 7 07:27:19 2022] GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:19.748890 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-83cd8aa4-5317-4877-b71f-2e01798c4dc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:19.757367 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-83cd8aa4-5317-4877-b71f-2e01798c4dc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:19.758866 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-83cd8aa4-5317-4877-b71f-2e01798c4dc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:19.760044 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-83cd8aa4-5317-4877-b71f-2e01798c4dc5 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.164585 Jul 07 07:27:19.760805 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 469/921] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:19 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:20.660001 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d29d384a-89c5-42d9-bfc3-b071f92fa874 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa074820>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:20.693124 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-d29d384a-89c5-42d9-bfc3-b071f92fa874 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] HTTP exception thrown: Snapshot 0d735eb9-392a-4aae-879e-572a8938f069 could not be found. Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d29d384a-89c5-42d9-bfc3-b071f92fa874 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Request method failure captured: Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069 HTTP/1.1 Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixorQrskGu1h-Il9Zh6xh2CzpHSWiDpCzCCv5hDoLRYCMtTWmMFObjRpagiq6gV3GW0iMp0dg1iaCpGlRlDkSOVsn_6YxyFsv5EFu2C0i-WjmTY9oDcRE6L1FfcBvt49SwZzwqmxYrh1kV8EhLeikKKtNT_H7ct8oQ45zSlSbkAl3xYg Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: d0d2ac10b1894b5c8eb63b19db6130d7 Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:27:20.696921 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: d0d2ac10b1894b5c8eb63b19db6130d7 Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesSnapshotsTestJSON-2097638778-project Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: f8b3f83c8c504de990ba9f5d900e52af Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2097638778-project Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Snapshot 0d735eb9-392a-4aae-879e-572a8938f069 could not be found. Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '0d735eb9-392a-4aae-879e-572a8938f069'} Jul 07 07:27:20.698760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0d735eb9-392a-4aae-879e-572a8938f069 could not be found. (HTTP 404) (Request-ID: req-9b10324c-a544-4158-81c2-9421bb0df625) Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:20.699771 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 07:27:20.701192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0d735eb9-392a-4aae-879e-572a8938f069 could not be found. Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 07 07:27:20.703777 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0d735eb9-392a-4aae-879e-572a8938f069 could not be found. Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0d735eb9-392a-4aae-879e-572a8938f069 could not be found. Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d29d384a-89c5-42d9-bfc3-b071f92fa874 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Returning 404 to user: Snapshot 0d735eb9-392a-4aae-879e-572a8938f069 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:20.706503 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d29d384a-89c5-42d9-bfc3-b071f92fa874 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069" status: 404 len: 111 microversion: 2.1 time: 0.048470 Jul 07 07:27:20.708616 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 453/922] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Jul 7 07:27:20 2022] GET /compute/v2.1/os-snapshots/0d735eb9-392a-4aae-879e-572a8938f069 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 07:27:20.715490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1a9ce8ee-b8b9-4785-8fa1-e5329b05c585 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa142b80>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:20.778121 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c8f93cfb-db8a-428a-9d9c-aeadf1c3a403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:20.778988 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c8f93cfb-db8a-428a-9d9c-aeadf1c3a403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:20.795423 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1a9ce8ee-b8b9-4785-8fa1-e5329b05c585 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21" status: 202 len: 0 microversion: 2.1 time: 0.085436 Jul 07 07:27:20.796086 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 470/923] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Jul 7 07:27:20 2022] DELETE /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:27:20.797244 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c8f93cfb-db8a-428a-9d9c-aeadf1c3a403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:20.798557 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c8f93cfb-db8a-428a-9d9c-aeadf1c3a403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:20.805478 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-0b71242f-5e5d-44f8-be39-8da60ba319ee tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa5049d0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:20.811478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c8f93cfb-db8a-428a-9d9c-aeadf1c3a403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:20.812048 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c8f93cfb-db8a-428a-9d9c-aeadf1c3a403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:20.899429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-0b71242f-5e5d-44f8-be39-8da60ba319ee tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21" status: 200 len: 344 microversion: 2.1 time: 0.098281 Jul 07 07:27:20.900596 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 471/924] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:27:20 2022] GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21 => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:27:20.923400 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-229b21af-1653-41cb-bbc7-f0f3447ee043 req-17a5b0f9-d693-4b89-8ad9-720dd4f3a712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb92117b-b521-46c1-bbef-7e97a808bab8", "name": "network-vif-plugged", "status": "completed", "tag": "304ba8c6-1b84-41a1-aaca-b548534ce32b"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:27:20.935709 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-229b21af-1653-41cb-bbc7-f0f3447ee043 req-17a5b0f9-d693-4b89-8ad9-720dd4f3a712 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:20.936594 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-229b21af-1653-41cb-bbc7-f0f3447ee043 req-17a5b0f9-d693-4b89-8ad9-720dd4f3a712 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:20.956130 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-229b21af-1653-41cb-bbc7-f0f3447ee043 req-17a5b0f9-d693-4b89-8ad9-720dd4f3a712 service nova] Creating event network-vif-plugged:304ba8c6-1b84-41a1-aaca-b548534ce32b for instance eb92117b-b521-46c1-bbef-7e97a808bab8 on hv-cinder-82660 Jul 07 07:27:20.963948 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-229b21af-1653-41cb-bbc7-f0f3447ee043 req-17a5b0f9-d693-4b89-8ad9-720dd4f3a712 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044007 Jul 07 07:27:20.965691 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 472/925] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:27:20.979787 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c8f93cfb-db8a-428a-9d9c-aeadf1c3a403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:20.991761 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c8f93cfb-db8a-428a-9d9c-aeadf1c3a403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:20.994233 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c8f93cfb-db8a-428a-9d9c-aeadf1c3a403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:20.995823 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c8f93cfb-db8a-428a-9d9c-aeadf1c3a403 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.221463 Jul 07 07:27:20.996384 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 454/926] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:20 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:21.913258 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cf67793f-7b2a-43af-948d-209d1b59dabe tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa225f70>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-cf67793f-7b2a-43af-948d-209d1b59dabe tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] HTTP exception thrown: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cf67793f-7b2a-43af-948d-209d1b59dabe tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Request method failure captured: Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21 HTTP/1.1 Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixorQrskGu1h-Il9Zh6xh2CzpHSWiDpCzCCv5hDoLRYCMtTWmMFObjRpagiq6gV3GW0iMp0dg1iaCpGlRlDkSOVsn_6YxyFsv5EFu2C0i-WjmTY9oDcRE6L1FfcBvt49SwZzwqmxYrh1kV8EhLeikKKtNT_H7ct8oQ45zSlSbkAl3xYg Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: d0d2ac10b1894b5c8eb63b19db6130d7 Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:27:21.947595 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: d0d2ac10b1894b5c8eb63b19db6130d7 Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotsTestJSON-2097638778-project Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: f8b3f83c8c504de990ba9f5d900e52af Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2097638778-project Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '0eef4da7-af46-4a70-8464-6d1538f36e21'} Jul 07 07:27:21.949151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. (HTTP 404) (Request-ID: req-d206d64b-4040-4f81-8494-1b4313cc1b01) Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:21.950633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 07:27:21.951760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 07:27:21.953521 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cf67793f-7b2a-43af-948d-209d1b59dabe tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Returning 404 to user: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cf67793f-7b2a-43af-948d-209d1b59dabe tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21" status: 404 len: 109 microversion: 2.1 time: 0.038073 Jul 07 07:27:21.954941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 473/927] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:27:21 2022] GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:21.961166 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-386c59c0-5d7e-4881-a483-55f8053d7093 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa126790>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:21.992026 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-386c59c0-5d7e-4881-a483-55f8053d7093 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] HTTP exception thrown: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-386c59c0-5d7e-4881-a483-55f8053d7093 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Request method failure captured: Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21 HTTP/1.1 Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixorQrskGu1h-Il9Zh6xh2CzpHSWiDpCzCCv5hDoLRYCMtTWmMFObjRpagiq6gV3GW0iMp0dg1iaCpGlRlDkSOVsn_6YxyFsv5EFu2C0i-WjmTY9oDcRE6L1FfcBvt49SwZzwqmxYrh1kV8EhLeikKKtNT_H7ct8oQ45zSlSbkAl3xYg Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: d0d2ac10b1894b5c8eb63b19db6130d7 Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:27:21.994089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: d0d2ac10b1894b5c8eb63b19db6130d7 Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesSnapshotsTestJSON-2097638778-project Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: f8b3f83c8c504de990ba9f5d900e52af Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2097638778-project Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '0eef4da7-af46-4a70-8464-6d1538f36e21'} Jul 07 07:27:21.995448 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. (HTTP 404) (Request-ID: req-0c65f397-2efc-4900-869b-9da9e6ff933c) Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:21.996253 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 07 07:27:21.998085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 07 07:27:21.999887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-386c59c0-5d7e-4881-a483-55f8053d7093 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Returning 404 to user: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-386c59c0-5d7e-4881-a483-55f8053d7093 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21" status: 404 len: 109 microversion: 2.1 time: 0.038299 Jul 07 07:27:22.001111 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 455/928] 10.222.0.62 () {58 vars in 1247 bytes} [Thu Jul 7 07:27:21 2022] DELETE /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 07 07:27:22.004437 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ca5881b0-8d49-4949-bcaf-555ad1a91fe6 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Calling method '.version_select at 0x7fccfa430b80>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:22.015268 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-377c1c20-b4e8-4e78-8c62-db895f44d1f2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:22.015972 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-377c1c20-b4e8-4e78-8c62-db895f44d1f2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:22.024507 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-377c1c20-b4e8-4e78-8c62-db895f44d1f2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:22.024952 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-377c1c20-b4e8-4e78-8c62-db895f44d1f2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:22.025766 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-377c1c20-b4e8-4e78-8c62-db895f44d1f2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:22.026198 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-377c1c20-b4e8-4e78-8c62-db895f44d1f2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:22.036155 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-ca5881b0-8d49-4949-bcaf-555ad1a91fe6 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] HTTP exception thrown: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ca5881b0-8d49-4949-bcaf-555ad1a91fe6 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Request method failure captured: Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21 HTTP/1.1 Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixorQrskGu1h-Il9Zh6xh2CzpHSWiDpCzCCv5hDoLRYCMtTWmMFObjRpagiq6gV3GW0iMp0dg1iaCpGlRlDkSOVsn_6YxyFsv5EFu2C0i-WjmTY9oDcRE6L1FfcBvt49SwZzwqmxYrh1kV8EhLeikKKtNT_H7ct8oQ45zSlSbkAl3xYg Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: d0d2ac10b1894b5c8eb63b19db6130d7 Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:27:22.038144 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d0d2ac10b1894b5c8eb63b19db6130d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: d0d2ac10b1894b5c8eb63b19db6130d7 Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2097638778 Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotsTestJSON-2097638778-project Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: f8b3f83c8c504de990ba9f5d900e52af Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2097638778-project Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '0eef4da7-af46-4a70-8464-6d1538f36e21'} Jul 07 07:27:22.039443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. (HTTP 404) (Request-ID: req-bc230064-651b-4d37-a583-e422a54aa60b) Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:22.041640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 07 07:27:22.042781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 07 07:27:22.043971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ca5881b0-8d49-4949-bcaf-555ad1a91fe6 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] Returning 404 to user: Volume 0eef4da7-af46-4a70-8464-6d1538f36e21 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ca5881b0-8d49-4949-bcaf-555ad1a91fe6 tempest-VolumesSnapshotsTestJSON-2097638778 tempest-VolumesSnapshotsTestJSON-2097638778-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21" status: 404 len: 109 microversion: 2.1 time: 0.038996 Jul 07 07:27:22.045344 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 474/929] 10.222.0.62 () {58 vars in 1244 bytes} [Thu Jul 7 07:27:21 2022] GET /compute/v2.1/os-volumes/0eef4da7-af46-4a70-8464-6d1538f36e21 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:27:22.183683 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-377c1c20-b4e8-4e78-8c62-db895f44d1f2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:22.194653 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-377c1c20-b4e8-4e78-8c62-db895f44d1f2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:22.196902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-377c1c20-b4e8-4e78-8c62-db895f44d1f2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:22.200868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-377c1c20-b4e8-4e78-8c62-db895f44d1f2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.187649 Jul 07 07:27:22.200868 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 456/930] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:22 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:27:23.220036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ce7020fa-4e12-4bc2-8a7f-7bb9cc3525b8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:23.220769 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ce7020fa-4e12-4bc2-8a7f-7bb9cc3525b8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:23.228808 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce7020fa-4e12-4bc2-8a7f-7bb9cc3525b8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:23.229201 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce7020fa-4e12-4bc2-8a7f-7bb9cc3525b8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:23.230409 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce7020fa-4e12-4bc2-8a7f-7bb9cc3525b8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:23.230850 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ce7020fa-4e12-4bc2-8a7f-7bb9cc3525b8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:23.478837 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ce7020fa-4e12-4bc2-8a7f-7bb9cc3525b8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:23.487788 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ce7020fa-4e12-4bc2-8a7f-7bb9cc3525b8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:23.489410 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ce7020fa-4e12-4bc2-8a7f-7bb9cc3525b8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:23.490810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ce7020fa-4e12-4bc2-8a7f-7bb9cc3525b8 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1731 microversion: 2.20 time: 0.277668 Jul 07 07:27:23.491563 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 475/931] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:23 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1731 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 07 07:27:24.512610 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c51239f5-373c-4f7c-bfc9-951734290594 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:24.513931 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c51239f5-373c-4f7c-bfc9-951734290594 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:24.527226 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c51239f5-373c-4f7c-bfc9-951734290594 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:24.528308 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c51239f5-373c-4f7c-bfc9-951734290594 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:24.529196 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c51239f5-373c-4f7c-bfc9-951734290594 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:24.529821 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c51239f5-373c-4f7c-bfc9-951734290594 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:24.713715 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c51239f5-373c-4f7c-bfc9-951734290594 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:24.723935 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c51239f5-373c-4f7c-bfc9-951734290594 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:24.726584 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c51239f5-373c-4f7c-bfc9-951734290594 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:24.727962 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c51239f5-373c-4f7c-bfc9-951734290594 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1718 microversion: 2.20 time: 0.222466 Jul 07 07:27:24.728789 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 457/932] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:27:24 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1718 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:27:43.919937 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1945308345", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "networks": [{"uuid": "a3b1f934-d744-4e19-a3e3-92112b05545b"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:27:43.927425 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=5 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:43.928095 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=15 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:43.976978 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] validate_networks() for [('a3b1f934-d744-4e19-a3e3-92112b05545b', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:27:44.607553 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:27:44.608280 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:27:44.609082 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:27:44.609786 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:27:44.610429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:27:44.620605 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:44.621051 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:44.621878 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:44.622315 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:44.640243 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Getting quotas for project 322cc6f4005b49f1889dcc6dca8043f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:27:44.644278 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Getting quotas for user ba90d232c52145288745a765f6131023 and project 322cc6f4005b49f1889dcc6dca8043f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:27:44.655827 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:27:44.658181 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:27:44.706036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-27b37498-6fe7-4476-9954-6f414ba45318 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790164 Jul 07 07:27:44.706773 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 476/933] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:27:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:27:44.716535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-2c678063-7b88-4587-879e-b7e8a6cca9f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:44.717149 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-2c678063-7b88-4587-879e-b7e8a6cca9f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:44.719990 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=51 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:44.720850 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=66 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:44.780814 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-2c678063-7b88-4587-879e-b7e8a6cca9f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:44.787896 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-2c678063-7b88-4587-879e-b7e8a6cca9f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1219 microversion: 2.1 time: 0.075148 Jul 07 07:27:44.788480 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 458/934] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:44 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:45.806725 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-07c5633a-7f58-4209-acc1-8bca83adafe5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:45.807687 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-07c5633a-7f58-4209-acc1-8bca83adafe5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:45.814095 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-07c5633a-7f58-4209-acc1-8bca83adafe5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:45.814544 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-07c5633a-7f58-4209-acc1-8bca83adafe5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:45.815307 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-07c5633a-7f58-4209-acc1-8bca83adafe5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:45.815736 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-07c5633a-7f58-4209-acc1-8bca83adafe5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:45.880359 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-07c5633a-7f58-4209-acc1-8bca83adafe5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:45.890799 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-07c5633a-7f58-4209-acc1-8bca83adafe5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1279 microversion: 2.1 time: 0.088968 Jul 07 07:27:45.891529 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 477/935] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:45 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:46.909647 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aff19083-74cb-49b0-9f02-a7cb4f3485f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:46.910565 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aff19083-74cb-49b0-9f02-a7cb4f3485f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:46.920099 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aff19083-74cb-49b0-9f02-a7cb4f3485f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:46.920558 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aff19083-74cb-49b0-9f02-a7cb4f3485f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:46.922017 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aff19083-74cb-49b0-9f02-a7cb4f3485f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:46.922588 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aff19083-74cb-49b0-9f02-a7cb4f3485f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:46.990593 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aff19083-74cb-49b0-9f02-a7cb4f3485f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:47.000825 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aff19083-74cb-49b0-9f02-a7cb4f3485f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1279 microversion: 2.1 time: 0.096145 Jul 07 07:27:47.001666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 459/936] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:46 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1279 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:48.020787 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2f07e77d-6960-429c-b4aa-5ef6beb5281d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:48.021475 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2f07e77d-6960-429c-b4aa-5ef6beb5281d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:48.031696 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f07e77d-6960-429c-b4aa-5ef6beb5281d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:48.032207 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f07e77d-6960-429c-b4aa-5ef6beb5281d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:48.033329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f07e77d-6960-429c-b4aa-5ef6beb5281d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:48.033982 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2f07e77d-6960-429c-b4aa-5ef6beb5281d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:48.104364 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2f07e77d-6960-429c-b4aa-5ef6beb5281d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:48.112874 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2f07e77d-6960-429c-b4aa-5ef6beb5281d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1279 microversion: 2.1 time: 0.097513 Jul 07 07:27:48.113519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 478/937] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:48 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1279 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:27:49.135602 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fada7ec7-ba5b-456c-b53f-5f8865a18c7c tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:49.136242 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fada7ec7-ba5b-456c-b53f-5f8865a18c7c tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:49.143619 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fada7ec7-ba5b-456c-b53f-5f8865a18c7c tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:49.144121 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fada7ec7-ba5b-456c-b53f-5f8865a18c7c tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:49.144937 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fada7ec7-ba5b-456c-b53f-5f8865a18c7c tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:49.145392 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fada7ec7-ba5b-456c-b53f-5f8865a18c7c tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:49.290526 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fada7ec7-ba5b-456c-b53f-5f8865a18c7c tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:49.301433 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fada7ec7-ba5b-456c-b53f-5f8865a18c7c tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1319 microversion: 2.1 time: 0.170181 Jul 07 07:27:49.313556 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 460/938] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:49 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:49.816408 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-b86dac11-fbd7-4b07-a2fe-8af842403119 req-1dd0ca87-32d7-4872-a6cd-1e7fdc5bfae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9", "tag": "92420e26-ab65-4d06-b6c4-68e65c1ba976"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:27:49.833996 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b86dac11-fbd7-4b07-a2fe-8af842403119 req-1dd0ca87-32d7-4872-a6cd-1e7fdc5bfae0 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:49.835072 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-b86dac11-fbd7-4b07-a2fe-8af842403119 req-1dd0ca87-32d7-4872-a6cd-1e7fdc5bfae0 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:49.850998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-b86dac11-fbd7-4b07-a2fe-8af842403119 req-1dd0ca87-32d7-4872-a6cd-1e7fdc5bfae0 service nova] Creating event network-changed:92420e26-ab65-4d06-b6c4-68e65c1ba976 for instance 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 on hv-cinder-82660 Jul 07 07:27:49.857316 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-b86dac11-fbd7-4b07-a2fe-8af842403119 req-1dd0ca87-32d7-4872-a6cd-1e7fdc5bfae0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047238 Jul 07 07:27:49.858588 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 479/939] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:50.325459 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7fb61fed-fbfe-4642-981a-fd22c9a9f4c2 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:50.326063 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7fb61fed-fbfe-4642-981a-fd22c9a9f4c2 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:50.336154 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7fb61fed-fbfe-4642-981a-fd22c9a9f4c2 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:50.336654 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7fb61fed-fbfe-4642-981a-fd22c9a9f4c2 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:50.337531 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7fb61fed-fbfe-4642-981a-fd22c9a9f4c2 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:50.338122 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7fb61fed-fbfe-4642-981a-fd22c9a9f4c2 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:50.475057 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7fb61fed-fbfe-4642-981a-fd22c9a9f4c2 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:50.483279 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7fb61fed-fbfe-4642-981a-fd22c9a9f4c2 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1319 microversion: 2.1 time: 0.162338 Jul 07 07:27:50.483854 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 461/940] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:50 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:51.500892 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ecef5542-a089-4082-8ba4-81d5fa805505 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:51.501683 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ecef5542-a089-4082-8ba4-81d5fa805505 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:51.510079 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ecef5542-a089-4082-8ba4-81d5fa805505 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:51.510448 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ecef5542-a089-4082-8ba4-81d5fa805505 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:51.511236 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ecef5542-a089-4082-8ba4-81d5fa805505 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:51.511860 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ecef5542-a089-4082-8ba4-81d5fa805505 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:51.652478 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ecef5542-a089-4082-8ba4-81d5fa805505 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:51.660119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ecef5542-a089-4082-8ba4-81d5fa805505 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1319 microversion: 2.1 time: 0.163678 Jul 07 07:27:51.660793 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 480/941] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:51 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:27:52.677259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0923f81b-e09e-4470-956c-6ca68158b9d9 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:52.677884 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0923f81b-e09e-4470-956c-6ca68158b9d9 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:52.684915 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0923f81b-e09e-4470-956c-6ca68158b9d9 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:52.685417 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0923f81b-e09e-4470-956c-6ca68158b9d9 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:52.686217 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0923f81b-e09e-4470-956c-6ca68158b9d9 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:52.686634 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0923f81b-e09e-4470-956c-6ca68158b9d9 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:52.822733 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0923f81b-e09e-4470-956c-6ca68158b9d9 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:52.830609 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0923f81b-e09e-4470-956c-6ca68158b9d9 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1319 microversion: 2.1 time: 0.157736 Jul 07 07:27:52.831181 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 462/942] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:52 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:53.849043 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-9f33a2cd-1f6b-4a03-8c4b-a0a9b2f286d8 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:53.850181 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-9f33a2cd-1f6b-4a03-8c4b-a0a9b2f286d8 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:53.857475 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f33a2cd-1f6b-4a03-8c4b-a0a9b2f286d8 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:53.858000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f33a2cd-1f6b-4a03-8c4b-a0a9b2f286d8 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:53.859004 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f33a2cd-1f6b-4a03-8c4b-a0a9b2f286d8 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:53.859613 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-9f33a2cd-1f6b-4a03-8c4b-a0a9b2f286d8 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:54.007130 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-9f33a2cd-1f6b-4a03-8c4b-a0a9b2f286d8 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:54.016118 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-9f33a2cd-1f6b-4a03-8c4b-a0a9b2f286d8 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1319 microversion: 2.1 time: 0.171989 Jul 07 07:27:54.016712 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 481/943] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:53 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:55.030451 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-7fd6ae92-e038-4712-9acf-3ebe6bff8ae7 req-775c2408-3577-4c12-a087-f364c9bdaec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9", "name": "network-vif-plugged", "status": "completed", "tag": "92420e26-ab65-4d06-b6c4-68e65c1ba976"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:27:55.037692 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-51d1fd8b-910c-4262-8a8a-3cac33ba89b0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:55.038976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-51d1fd8b-910c-4262-8a8a-3cac33ba89b0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:55.041465 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:55.043539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:55.044438 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=6 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:27:55.044674 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7fd6ae92-e038-4712-9acf-3ebe6bff8ae7 req-775c2408-3577-4c12-a087-f364c9bdaec2 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:55.045133 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7fd6ae92-e038-4712-9acf-3ebe6bff8ae7 req-775c2408-3577-4c12-a087-f364c9bdaec2 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:55.052691 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-51d1fd8b-910c-4262-8a8a-3cac33ba89b0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:55.053459 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-51d1fd8b-910c-4262-8a8a-3cac33ba89b0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:55.054527 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-51d1fd8b-910c-4262-8a8a-3cac33ba89b0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:55.055123 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-51d1fd8b-910c-4262-8a8a-3cac33ba89b0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:55.060224 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-7fd6ae92-e038-4712-9acf-3ebe6bff8ae7 req-775c2408-3577-4c12-a087-f364c9bdaec2 service nova] Creating event network-vif-plugged:92420e26-ab65-4d06-b6c4-68e65c1ba976 for instance 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 on hv-cinder-82660 Jul 07 07:27:55.065689 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-7fd6ae92-e038-4712-9acf-3ebe6bff8ae7 req-775c2408-3577-4c12-a087-f364c9bdaec2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041067 Jul 07 07:27:55.066652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 463/944] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:27:55.218067 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-51d1fd8b-910c-4262-8a8a-3cac33ba89b0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:55.234619 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-51d1fd8b-910c-4262-8a8a-3cac33ba89b0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1319 microversion: 2.1 time: 0.204179 Jul 07 07:27:55.235712 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 482/945] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:55 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:56.255930 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-22217cfc-86dd-49d4-8c99-bbaeca2e8477 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:56.256645 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-22217cfc-86dd-49d4-8c99-bbaeca2e8477 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:56.264130 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22217cfc-86dd-49d4-8c99-bbaeca2e8477 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:56.264623 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22217cfc-86dd-49d4-8c99-bbaeca2e8477 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:56.265550 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22217cfc-86dd-49d4-8c99-bbaeca2e8477 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:56.266053 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-22217cfc-86dd-49d4-8c99-bbaeca2e8477 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:56.412880 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-22217cfc-86dd-49d4-8c99-bbaeca2e8477 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:56.420575 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-22217cfc-86dd-49d4-8c99-bbaeca2e8477 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1319 microversion: 2.1 time: 0.169921 Jul 07 07:27:56.421156 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 464/946] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:56 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:27:57.438702 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fd30b6f7-34a3-4bfb-bcaf-83b29df6f02f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:27:57.439387 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fd30b6f7-34a3-4bfb-bcaf-83b29df6f02f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:27:57.446301 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fd30b6f7-34a3-4bfb-bcaf-83b29df6f02f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:57.446753 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fd30b6f7-34a3-4bfb-bcaf-83b29df6f02f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:57.447546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fd30b6f7-34a3-4bfb-bcaf-83b29df6f02f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:27:57.448000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fd30b6f7-34a3-4bfb-bcaf-83b29df6f02f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:27:57.601932 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-fd30b6f7-34a3-4bfb-bcaf-83b29df6f02f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:27:57.609949 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fd30b6f7-34a3-4bfb-bcaf-83b29df6f02f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1508 microversion: 2.1 time: 0.175811 Jul 07 07:27:57.610537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 483/947] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:27:57 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:28:04.077170 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-27124785-811d-4614-945e-bf87feedea78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:04.078191 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-27124785-811d-4614-945e-bf87feedea78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:04.085597 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27124785-811d-4614-945e-bf87feedea78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:04.086063 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27124785-811d-4614-945e-bf87feedea78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:04.086922 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27124785-811d-4614-945e-bf87feedea78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:04.087365 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-27124785-811d-4614-945e-bf87feedea78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:04.119675 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-27124785-811d-4614-945e-bf87feedea78 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046547 Jul 07 07:28:04.120245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 465/948] 10.222.0.62 () {60 vars in 1342 bytes} [Thu Jul 7 07:28:04 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:28:04.183114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e398fb25-b848-4ec0-b2d9-ab44bc21080f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:04.184574 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e398fb25-b848-4ec0-b2d9-ab44bc21080f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:04.193749 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e398fb25-b848-4ec0-b2d9-ab44bc21080f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:04.194300 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e398fb25-b848-4ec0-b2d9-ab44bc21080f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:04.195408 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e398fb25-b848-4ec0-b2d9-ab44bc21080f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:04.195859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e398fb25-b848-4ec0-b2d9-ab44bc21080f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:04.228975 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e398fb25-b848-4ec0-b2d9-ab44bc21080f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:28:04.331620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e398fb25-b848-4ec0-b2d9-ab44bc21080f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 204 len: 0 microversion: 2.20 time: 0.152993 Jul 07 07:28:04.332443 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 484/949] 10.222.0.62 () {60 vars in 1279 bytes} [Thu Jul 7 07:28:04 2022] DELETE /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 07:28:04.342573 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-311d55a7-e3b0-4e5e-8f76-f80d85dd4a27 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:04.343409 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-311d55a7-e3b0-4e5e-8f76-f80d85dd4a27 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:04.350403 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-311d55a7-e3b0-4e5e-8f76-f80d85dd4a27 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:04.350859 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-311d55a7-e3b0-4e5e-8f76-f80d85dd4a27 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:04.351643 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-311d55a7-e3b0-4e5e-8f76-f80d85dd4a27 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:04.352081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-311d55a7-e3b0-4e5e-8f76-f80d85dd4a27 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:04.489417 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-311d55a7-e3b0-4e5e-8f76-f80d85dd4a27 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:04.497441 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-311d55a7-e3b0-4e5e-8f76-f80d85dd4a27 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:04.499007 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-311d55a7-e3b0-4e5e-8f76-f80d85dd4a27 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:04.500214 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-311d55a7-e3b0-4e5e-8f76-f80d85dd4a27 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.162044 Jul 07 07:28:04.500796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 466/950] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:28:04 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:28:05.520899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5caa0d9c-483c-4d67-b013-3ea5af725d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:05.521629 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5caa0d9c-483c-4d67-b013-3ea5af725d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:05.528908 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5caa0d9c-483c-4d67-b013-3ea5af725d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:05.529391 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5caa0d9c-483c-4d67-b013-3ea5af725d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:05.530171 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5caa0d9c-483c-4d67-b013-3ea5af725d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:05.530605 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5caa0d9c-483c-4d67-b013-3ea5af725d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:05.674333 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5caa0d9c-483c-4d67-b013-3ea5af725d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:05.683017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5caa0d9c-483c-4d67-b013-3ea5af725d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:05.684512 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5caa0d9c-483c-4d67-b013-3ea5af725d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:05.685693 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5caa0d9c-483c-4d67-b013-3ea5af725d9f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.169204 Jul 07 07:28:05.686251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 485/951] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:28:05 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:28:06.704937 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-674791dd-5d13-4b36-b0c9-a83265097036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:06.705556 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-674791dd-5d13-4b36-b0c9-a83265097036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:06.718694 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-674791dd-5d13-4b36-b0c9-a83265097036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:06.719525 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-674791dd-5d13-4b36-b0c9-a83265097036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:06.721391 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-674791dd-5d13-4b36-b0c9-a83265097036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:06.721839 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-674791dd-5d13-4b36-b0c9-a83265097036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:06.866629 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-674791dd-5d13-4b36-b0c9-a83265097036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:06.877037 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-674791dd-5d13-4b36-b0c9-a83265097036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:06.878997 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-674791dd-5d13-4b36-b0c9-a83265097036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6db138644b14a20a43b3b1b3fa63314', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e48122318d446438ef9974475c3f6ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:06.890295 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-674791dd-5d13-4b36-b0c9-a83265097036 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 200 len: 1724 microversion: 2.20 time: 0.189670 Jul 07 07:28:06.890968 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 467/952] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:28:06 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 07 07:28:07.168244 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-ab71e477-c2b3-4b4f-b557-cc16edfbf89e req-70bd8630-9b5f-4918-9fdb-658d59f94069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb92117b-b521-46c1-bbef-7e97a808bab8", "name": "network-vif-deleted", "tag": "304ba8c6-1b84-41a1-aaca-b548534ce32b"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:28:07.177028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ab71e477-c2b3-4b4f-b557-cc16edfbf89e req-70bd8630-9b5f-4918-9fdb-658d59f94069 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:07.177600 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-ab71e477-c2b3-4b4f-b557-cc16edfbf89e req-70bd8630-9b5f-4918-9fdb-658d59f94069 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:07.199152 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-ab71e477-c2b3-4b4f-b557-cc16edfbf89e req-70bd8630-9b5f-4918-9fdb-658d59f94069 service nova] Creating event network-vif-deleted:304ba8c6-1b84-41a1-aaca-b548534ce32b for instance eb92117b-b521-46c1-bbef-7e97a808bab8 on hv-cinder-82660 Jul 07 07:28:07.204712 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-ab71e477-c2b3-4b4f-b557-cc16edfbf89e req-70bd8630-9b5f-4918-9fdb-658d59f94069 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040262 Jul 07 07:28:07.209584 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 486/953] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:28:07.912455 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-23aa92f8-bd53-427b-95b5-f76809f3064f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:07.913707 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-23aa92f8-bd53-427b-95b5-f76809f3064f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:07.923165 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23aa92f8-bd53-427b-95b5-f76809f3064f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:07.923848 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23aa92f8-bd53-427b-95b5-f76809f3064f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:07.924786 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23aa92f8-bd53-427b-95b5-f76809f3064f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:07.925478 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-23aa92f8-bd53-427b-95b5-f76809f3064f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:07.942356 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-23aa92f8-bd53-427b-95b5-f76809f3064f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] HTTP exception thrown: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-23aa92f8-bd53-427b-95b5-f76809f3064f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Request method failure captured: Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 HTTP/1.1 Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok2aoNzCeuUXC_Pw4YcoECVvmWHDMVuY8kjsOk3CwDYpNIk6nRnjSQM4u2c-8R9ljZsLWDRlbyvgGj3W7jwveCkTMn53ZUEHuuPyTEuussFIxzv5_2LNDkUPHsGydRCwjsAImfUm4UqdNhL9IgV6v732kZJuDUjv7askuuVqPrDFaA Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:28:07.944069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7e48122318d446438ef9974475c3f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: d6db138644b14a20a43b3b1b3fa63314 Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:07.946328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'eb92117b-b521-46c1-bbef-7e97a808bab8'} Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:28:07.947649 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:07.949266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:07.952344 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-23aa92f8-bd53-427b-95b5-f76809f3064f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Returning 404 to user: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:28:07.952344 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-23aa92f8-bd53-427b-95b5-f76809f3064f tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 404 len: 111 microversion: 2.20 time: 0.038721 Jul 07 07:28:07.952344 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 468/954] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:28:07 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 07:28:07.955413 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c696b0d5-abfe-4495-ac6a-86aa5590fabe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '.version_select at 0x7fccfa31f8b0>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:07.984531 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c696b0d5-abfe-4495-ac6a-86aa5590fabe tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678075745" status: 204 len: 0 microversion: 2.20 time: 0.033276 Jul 07 07:28:07.985154 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 487/955] 10.222.0.62 () {60 vars in 1261 bytes} [Thu Jul 7 07:28:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678075745 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 07 07:28:09.916408 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f589be2-d98e-4871-b7a9-8581e5593f13 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:09.916918 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3f589be2-d98e-4871-b7a9-8581e5593f13 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:09.923871 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f589be2-d98e-4871-b7a9-8581e5593f13 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:09.924314 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f589be2-d98e-4871-b7a9-8581e5593f13 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:09.925116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f589be2-d98e-4871-b7a9-8581e5593f13 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:09.925584 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-3f589be2-d98e-4871-b7a9-8581e5593f13 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:09.939745 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-3f589be2-d98e-4871-b7a9-8581e5593f13 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] HTTP exception thrown: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f589be2-d98e-4871-b7a9-8581e5593f13 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Request method failure captured: Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 HTTP/1.1 Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok2aoNzCeuUXC_Pw4YcoECVvmWHDMVuY8kjsOk3CwDYpNIk6nRnjSQM4u2c-8R9ljZsLWDRlbyvgGj3W7jwveCkTMn53ZUEHuuPyTEuussFIxzv5_2LNDkUPHsGydRCwjsAImfUm4UqdNhL9IgV6v732kZJuDUjv7askuuVqPrDFaA Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:28:09.941328 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7e48122318d446438ef9974475c3f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: d6db138644b14a20a43b3b1b3fa63314 Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:09.942902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'eb92117b-b521-46c1-bbef-7e97a808bab8'} Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:28:09.943812 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:09.945487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:09.947025 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3f589be2-d98e-4871-b7a9-8581e5593f13 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Returning 404 to user: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:28:09.947025 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3f589be2-d98e-4871-b7a9-8581e5593f13 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "DELETE /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 404 len: 111 microversion: 2.20 time: 0.030266 Jul 07 07:28:09.947025 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 469/956] 10.222.0.62 () {60 vars in 1279 bytes} [Thu Jul 7 07:28:09 2022] DELETE /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 07:28:09.952120 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6638ed56-3b3b-48fa-93f0-50b8e427eebd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:09.952858 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6638ed56-3b3b-48fa-93f0-50b8e427eebd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: eb92117b-b521-46c1-bbef-7e97a808bab8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:09.959718 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6638ed56-3b3b-48fa-93f0-50b8e427eebd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:09.960153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6638ed56-3b3b-48fa-93f0-50b8e427eebd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:09.960927 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6638ed56-3b3b-48fa-93f0-50b8e427eebd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:09.961408 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6638ed56-3b3b-48fa-93f0-50b8e427eebd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:09.975322 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-6638ed56-3b3b-48fa-93f0-50b8e427eebd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] HTTP exception thrown: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6638ed56-3b3b-48fa-93f0-50b8e427eebd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Request method failure captured: Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 HTTP/1.1 Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixok2aoNzCeuUXC_Pw4YcoECVvmWHDMVuY8kjsOk3CwDYpNIk6nRnjSQM4u2c-8R9ljZsLWDRlbyvgGj3W7jwveCkTMn53ZUEHuuPyTEuussFIxzv5_2LNDkUPHsGydRCwjsAImfUm4UqdNhL9IgV6v732kZJuDUjv7askuuVqPrDFaA Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:28:09.976976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7e48122318d446438ef9974475c3f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: d6db138644b14a20a43b3b1b3fa63314 Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:09.978583 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': 'eb92117b-b521-46c1-bbef-7e97a808bab8'} Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:28:09.979630 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. Jul 07 07:28:09.981206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:09.983081 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6638ed56-3b3b-48fa-93f0-50b8e427eebd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Returning 404 to user: Instance eb92117b-b521-46c1-bbef-7e97a808bab8 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:28:09.983081 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6638ed56-3b3b-48fa-93f0-50b8e427eebd tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8" status: 404 len: 111 microversion: 2.20 time: 0.030815 Jul 07 07:28:09.983081 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 488/957] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:28:09 2022] GET /compute/v2.1/servers/eb92117b-b521-46c1-bbef-7e97a808bab8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 07:28:11.125801 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cc01b328-118a-4974-98b1-54cce68f64a2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:11.126408 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cc01b328-118a-4974-98b1-54cce68f64a2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:11.134692 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc01b328-118a-4974-98b1-54cce68f64a2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:11.135144 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc01b328-118a-4974-98b1-54cce68f64a2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:11.135917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc01b328-118a-4974-98b1-54cce68f64a2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:11.136349 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cc01b328-118a-4974-98b1-54cce68f64a2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:11.151659 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-cc01b328-118a-4974-98b1-54cce68f64a2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] HTTP exception thrown: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cc01b328-118a-4974-98b1-54cce68f64a2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Request method failure captured: Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c HTTP/1.1 Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixok2aoNzCeuUXC_Pw4YcoECVvmWHDMVuY8kjsOk3CwDYpNIk6nRnjSQM4u2c-8R9ljZsLWDRlbyvgGj3W7jwveCkTMn53ZUEHuuPyTEuussFIxzv5_2LNDkUPHsGydRCwjsAImfUm4UqdNhL9IgV6v732kZJuDUjv7askuuVqPrDFaA Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:28:11.153237 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7e48122318d446438ef9974475c3f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: d6db138644b14a20a43b3b1b3fa63314 Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:28:11.154807 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c'} Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:28:11.155585 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:28:11.156748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:28:11.158259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cc01b328-118a-4974-98b1-54cce68f64a2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Returning 404 to user: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:28:11.158259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cc01b328-118a-4974-98b1-54cce68f64a2 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 404 len: 111 microversion: 2.20 time: 0.033919 Jul 07 07:28:11.158259 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 470/958] 10.222.0.62 () {60 vars in 1279 bytes} [Thu Jul 7 07:28:11 2022] DELETE /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 07:28:11.163448 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fea2bab8-e238-4e45-b2e8-726771262634 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:11.164063 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fea2bab8-e238-4e45-b2e8-726771262634 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] [instance: 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:11.171155 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fea2bab8-e238-4e45-b2e8-726771262634 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:11.171633 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fea2bab8-e238-4e45-b2e8-726771262634 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:11.172406 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fea2bab8-e238-4e45-b2e8-726771262634 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:11.172843 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fea2bab8-e238-4e45-b2e8-726771262634 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:11.187043 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-fea2bab8-e238-4e45-b2e8-726771262634 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] HTTP exception thrown: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fea2bab8-e238-4e45-b2e8-726771262634 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Request method failure captured: Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c HTTP/1.1 Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixok2aoNzCeuUXC_Pw4YcoECVvmWHDMVuY8kjsOk3CwDYpNIk6nRnjSQM4u2c-8R9ljZsLWDRlbyvgGj3W7jwveCkTMn53ZUEHuuPyTEuussFIxzv5_2LNDkUPHsGydRCwjsAImfUm4UqdNhL9IgV6v732kZJuDUjv7askuuVqPrDFaA Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Openstack-Nova-Api-Version: 2.20 Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:28:11.188586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7e48122318d446438ef9974475c3f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7e48122318d446438ef9974475c3f6ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 7e48122318d446438ef9974475c3f6ca Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1200769152 Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: d6db138644b14a20a43b3b1b3fa63314 Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1200769152-project Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:28:11.190271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c'} Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:28:11.191094 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. Jul 07 07:28:11.192564 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:11.193869 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fea2bab8-e238-4e45-b2e8-726771262634 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] Returning 404 to user: Instance 5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:28:11.193869 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fea2bab8-e238-4e45-b2e8-726771262634 tempest-AttachVolumeShelveTestJSON-1200769152 tempest-AttachVolumeShelveTestJSON-1200769152-project] 10.222.0.62 "GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c" status: 404 len: 111 microversion: 2.20 time: 0.030590 Jul 07 07:28:11.193869 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 489/959] 10.222.0.62 () {60 vars in 1276 bytes} [Thu Jul 7 07:28:11 2022] GET /compute/v2.1/servers/5d2b3a0f-9766-439c-b8bc-b0e6a8318e8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 07 07:28:18.391249 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-903b350d-ca97-4bc5-90b5-c9024c74c3f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0ecad0b-51dd-4b07-a904-8a9e8ab16b11", "device": "/dev/sdb"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:28:18.394172 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-903b350d-ca97-4bc5-90b5-c9024c74c3f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:18.398553 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=29 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:18.407603 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-903b350d-ca97-4bc5-90b5-c9024c74c3f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:18.408325 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-903b350d-ca97-4bc5-90b5-c9024c74c3f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:18.409959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-903b350d-ca97-4bc5-90b5-c9024c74c3f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:18.410340 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-903b350d-ca97-4bc5-90b5-c9024c74c3f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:18.414435 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=57 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:18.707278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-903b350d-ca97-4bc5-90b5-c9024c74c3f0 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "POST /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.323387 Jul 07 07:28:18.708346 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 471/960] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:28:18 2022] POST /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:28:21.703216 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f1a8c085-a0cc-420f-b8f1-eccda44ff08d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:21.703723 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f1a8c085-a0cc-420f-b8f1-eccda44ff08d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:21.711185 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-7f392ac0-bc32-4fcd-8526-6c83c63f87ab req-bf4ce0f7-2988-4786-b4f8-34617fc4405c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83944e7d-3750-4747-92ae-6a1f735c79fc", "tag": "19dfde08-41d9-41e9-b31b-405a6dc8008a"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:28:21.715939 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:21.721616 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:21.729847 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7f392ac0-bc32-4fcd-8526-6c83c63f87ab req-bf4ce0f7-2988-4786-b4f8-34617fc4405c service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:21.730295 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7f392ac0-bc32-4fcd-8526-6c83c63f87ab req-bf4ce0f7-2988-4786-b4f8-34617fc4405c service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:21.736970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1a8c085-a0cc-420f-b8f1-eccda44ff08d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:21.737642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1a8c085-a0cc-420f-b8f1-eccda44ff08d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:21.738469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1a8c085-a0cc-420f-b8f1-eccda44ff08d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:21.741904 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f1a8c085-a0cc-420f-b8f1-eccda44ff08d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:21.756251 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-7f392ac0-bc32-4fcd-8526-6c83c63f87ab req-bf4ce0f7-2988-4786-b4f8-34617fc4405c service nova] Creating event network-changed:19dfde08-41d9-41e9-b31b-405a6dc8008a for instance 83944e7d-3750-4747-92ae-6a1f735c79fc on hv-cinder-82660 Jul 07 07:28:21.774329 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-7f392ac0-bc32-4fcd-8526-6c83c63f87ab req-bf4ce0f7-2988-4786-b4f8-34617fc4405c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067502 Jul 07 07:28:21.775340 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 472/961] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:28:21.788311 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f1a8c085-a0cc-420f-b8f1-eccda44ff08d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:28:21.889840 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f1a8c085-a0cc-420f-b8f1-eccda44ff08d tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "DELETE /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 204 len: 0 microversion: 2.1 time: 0.189699 Jul 07 07:28:21.891431 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 490/962] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:28:21 2022] DELETE /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:28:21.900901 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ca8fe26e-10fd-4a28-896a-4cc5fb78fdf0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:21.901924 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ca8fe26e-10fd-4a28-896a-4cc5fb78fdf0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:21.908838 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca8fe26e-10fd-4a28-896a-4cc5fb78fdf0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:21.909535 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca8fe26e-10fd-4a28-896a-4cc5fb78fdf0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:21.910532 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca8fe26e-10fd-4a28-896a-4cc5fb78fdf0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:21.911108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca8fe26e-10fd-4a28-896a-4cc5fb78fdf0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:22.113770 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ca8fe26e-10fd-4a28-896a-4cc5fb78fdf0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:22.128675 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ca8fe26e-10fd-4a28-896a-4cc5fb78fdf0 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.232718 Jul 07 07:28:22.141889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 473/963] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:28:21 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:28:23.148036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2810c3d5-b40e-47a1-af79-cbdee03dde2a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:23.148746 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2810c3d5-b40e-47a1-af79-cbdee03dde2a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:23.156462 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2810c3d5-b40e-47a1-af79-cbdee03dde2a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:23.156918 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2810c3d5-b40e-47a1-af79-cbdee03dde2a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:23.157746 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2810c3d5-b40e-47a1-af79-cbdee03dde2a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:23.158299 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2810c3d5-b40e-47a1-af79-cbdee03dde2a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:23.329801 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2810c3d5-b40e-47a1-af79-cbdee03dde2a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:23.349962 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2810c3d5-b40e-47a1-af79-cbdee03dde2a tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.206265 Jul 07 07:28:23.357285 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 491/964] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:28:23 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:28:24.380192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b4d67a16-f89d-4128-841f-b5482cc3081f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:24.381194 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b4d67a16-f89d-4128-841f-b5482cc3081f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:24.390744 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4d67a16-f89d-4128-841f-b5482cc3081f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:24.392381 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4d67a16-f89d-4128-841f-b5482cc3081f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:24.394131 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4d67a16-f89d-4128-841f-b5482cc3081f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:24.394920 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b4d67a16-f89d-4128-841f-b5482cc3081f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:24.625787 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b4d67a16-f89d-4128-841f-b5482cc3081f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:24.635108 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b4d67a16-f89d-4128-841f-b5482cc3081f tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1565 microversion: 2.1 time: 0.263667 Jul 07 07:28:24.646209 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 474/965] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:28:24 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1565 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:28:25.366941 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-921bc918-a4e1-4952-8de2-7a943467148b req-1f59d005-4e07-45c5-8450-d5ae692d8b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83944e7d-3750-4747-92ae-6a1f735c79fc", "name": "network-vif-deleted", "tag": "19dfde08-41d9-41e9-b31b-405a6dc8008a"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:28:25.376764 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-921bc918-a4e1-4952-8de2-7a943467148b req-1f59d005-4e07-45c5-8450-d5ae692d8b50 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:25.377209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-921bc918-a4e1-4952-8de2-7a943467148b req-1f59d005-4e07-45c5-8450-d5ae692d8b50 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:25.399773 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-921bc918-a4e1-4952-8de2-7a943467148b req-1f59d005-4e07-45c5-8450-d5ae692d8b50 service nova] Creating event network-vif-deleted:19dfde08-41d9-41e9-b31b-405a6dc8008a for instance 83944e7d-3750-4747-92ae-6a1f735c79fc on hv-cinder-82660 Jul 07 07:28:25.407351 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-921bc918-a4e1-4952-8de2-7a943467148b req-1f59d005-4e07-45c5-8450-d5ae692d8b50 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043981 Jul 07 07:28:25.413518 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 492/966] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:28:25.655665 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9957c8e5-8302-46d8-bebc-6dccfe99ee15 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:25.657619 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9957c8e5-8302-46d8-bebc-6dccfe99ee15 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:25.673548 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9957c8e5-8302-46d8-bebc-6dccfe99ee15 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:25.674245 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9957c8e5-8302-46d8-bebc-6dccfe99ee15 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:25.675471 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9957c8e5-8302-46d8-bebc-6dccfe99ee15 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:25.676266 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9957c8e5-8302-46d8-bebc-6dccfe99ee15 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:25.801116 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-9957c8e5-8302-46d8-bebc-6dccfe99ee15 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f0d73f1807487ca3eb016660b29f47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee25b35791243e698a41375cca91cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:25.818957 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9957c8e5-8302-46d8-bebc-6dccfe99ee15 tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 200 len: 1218 microversion: 2.1 time: 0.168874 Jul 07 07:28:25.819899 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 475/967] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:28:25 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:28:26.838405 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c5b11f12-d616-4de2-9e17-17adb3a5b55c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:26.839208 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c5b11f12-d616-4de2-9e17-17adb3a5b55c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] [instance: 83944e7d-3750-4747-92ae-6a1f735c79fc] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:26.857113 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c5b11f12-d616-4de2-9e17-17adb3a5b55c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:26.859194 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c5b11f12-d616-4de2-9e17-17adb3a5b55c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:26.861429 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c5b11f12-d616-4de2-9e17-17adb3a5b55c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:26.862508 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c5b11f12-d616-4de2-9e17-17adb3a5b55c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:26.880335 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-c5b11f12-d616-4de2-9e17-17adb3a5b55c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] HTTP exception thrown: Instance 83944e7d-3750-4747-92ae-6a1f735c79fc could not be found. Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c5b11f12-d616-4de2-9e17-17adb3a5b55c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Request method failure captured: Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc HTTP/1.1 Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixonFwN-F2EDmo8OB0-SvGR6e5WR8kIzL1o0JUhgUj26Z7DuJwp5i_EUEE4__rZ4T7RxiZSOq5j7C4P69hjo2BKrdddMpvbM0uHm4fo2p29ewzl3NCtteCoYrl9LIA3UEDvmBHKZLmzD-pM7Q4Woy5K8ENGYXekUR6Is3V4qVbJ26mV0 Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 9ee25b35791243e698a41375cca91cea Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestShelveInstance-1477667483 Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:28:26.882142 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9ee25b35791243e698a41375cca91cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/9ee25b35791243e698a41375cca91cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_9ee25b35791243e698a41375cca91cea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/9ee25b35791243e698a41375cca91cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestShelveInstance-1477667483 Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 9ee25b35791243e698a41375cca91cea Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestShelveInstance-1477667483 Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-TestShelveInstance-1477667483-project Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: e1f0d73f1807487ca3eb016660b29f47 Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestShelveInstance-1477667483-project Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 83944e7d-3750-4747-92ae-6a1f735c79fc could not be found. Jul 07 07:28:26.884050 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '83944e7d-3750-4747-92ae-6a1f735c79fc'} Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83944e7d-3750-4747-92ae-6a1f735c79fc could not be found. Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:28:26.885139 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83944e7d-3750-4747-92ae-6a1f735c79fc could not be found. Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83944e7d-3750-4747-92ae-6a1f735c79fc could not be found. Jul 07 07:28:26.886758 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:26.889271 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c5b11f12-d616-4de2-9e17-17adb3a5b55c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Returning 404 to user: Instance 83944e7d-3750-4747-92ae-6a1f735c79fc could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:28:26.890622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c5b11f12-d616-4de2-9e17-17adb3a5b55c tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc" status: 404 len: 111 microversion: 2.1 time: 0.057833 Jul 07 07:28:26.894794 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 493/968] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:28:26 2022] GET /compute/v2.1/servers/83944e7d-3750-4747-92ae-6a1f735c79fc => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:28:27.093885 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b981c518-f3ea-4464-9443-703832764d5e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] Calling method '.version_select at 0x7fccf9fd8550>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:27.117519 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b981c518-f3ea-4464-9443-703832764d5e tempest-TestShelveInstance-1477667483 tempest-TestShelveInstance-1477667483-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-945349269" status: 202 len: 0 microversion: 2.1 time: 0.037069 Jul 07 07:28:27.118268 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 476/969] 10.222.0.62 () {58 vars in 1250 bytes} [Thu Jul 7 07:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-945349269 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:28:31.308719 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-8feefb0e-65ec-4331-99c3-e6f1b28ea50d tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Action: 'create', calling method: .version_select at 0x7fccf9f120d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-820613128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfKmrw5p6KO0CZlJLpmy8RBTmI/5EQ6v6BqaP08wieEnAnk6R/Usz+ybC8gPKWf4xq7mvelZyZWXRArET+VIkJ9DP3lbmzZWyyY/X7gOgKQaS6jgv9pWE+izldITgOrEQ=="}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:28:31.328779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-8feefb0e-65ec-4331-99c3-e6f1b28ea50d tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Getting quotas for project aafd6d9a6d134f538a61498790991c0c. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:28:31.333326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-8feefb0e-65ec-4331-99c3-e6f1b28ea50d tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Getting quotas for user 63d931e360f94cf78880ec2f2970a066 and project aafd6d9a6d134f538a61498790991c0c. Resources: {'key_pairs'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:28:31.356594 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-8feefb0e-65ec-4331-99c3-e6f1b28ea50d tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.264982 Jul 07 07:28:31.357200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 494/970] 10.222.0.62 () {60 vars in 1158 bytes} [Thu Jul 7 07:28:31 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:28:48.581522 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:48.582336 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:48.586912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-acd8f89e-95ad-4e77-8173-fa929572db78 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:48.587446 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-acd8f89e-95ad-4e77-8173-fa929572db78 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:48.596089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-acd8f89e-95ad-4e77-8173-fa929572db78 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:48.596669 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-acd8f89e-95ad-4e77-8173-fa929572db78 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:48.597609 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-acd8f89e-95ad-4e77-8173-fa929572db78 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:48.598057 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-acd8f89e-95ad-4e77-8173-fa929572db78 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:48.686453 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-acd8f89e-95ad-4e77-8173-fa929572db78 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lazy-loading 'services' on Instance uuid 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:28:48.771487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-acd8f89e-95ad-4e77-8173-fa929572db78 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9/os-volume_attachments/d0ecad0b-51dd-4b07-a904-8a9e8ab16b11" status: 202 len: 0 microversion: 2.1 time: 0.191394 Jul 07 07:28:48.772133 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 477/971] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:28:48 2022] DELETE /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9/os-volume_attachments/d0ecad0b-51dd-4b07-a904-8a9e8ab16b11 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:28:49.893900 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:49.894681 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:49.895411 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:28:49.899698 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-67000929-f3b8-4350-807e-0a1e981a6857 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:49.900269 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-67000929-f3b8-4350-807e-0a1e981a6857 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:49.909211 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67000929-f3b8-4350-807e-0a1e981a6857 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:49.909767 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67000929-f3b8-4350-807e-0a1e981a6857 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:49.910535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67000929-f3b8-4350-807e-0a1e981a6857 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:49.910968 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67000929-f3b8-4350-807e-0a1e981a6857 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:49.938444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-67000929-f3b8-4350-807e-0a1e981a6857 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:28:50.042511 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-67000929-f3b8-4350-807e-0a1e981a6857 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 204 len: 0 microversion: 2.1 time: 0.150132 Jul 07 07:28:50.043099 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 495/972] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:28:49 2022] DELETE /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:28:50.052548 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d58cd2a1-5389-4140-b4f0-e5d895b66659 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:50.053263 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d58cd2a1-5389-4140-b4f0-e5d895b66659 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:50.059995 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d58cd2a1-5389-4140-b4f0-e5d895b66659 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:50.060437 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d58cd2a1-5389-4140-b4f0-e5d895b66659 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:50.061184 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d58cd2a1-5389-4140-b4f0-e5d895b66659 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:50.061648 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d58cd2a1-5389-4140-b4f0-e5d895b66659 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:50.203855 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d58cd2a1-5389-4140-b4f0-e5d895b66659 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:50.211768 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d58cd2a1-5389-4140-b4f0-e5d895b66659 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1514 microversion: 2.1 time: 0.164129 Jul 07 07:28:50.212367 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 478/973] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:28:50 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:28:51.230870 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-85363433-f258-4568-9ad9-2ecf259d9538 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:51.231577 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-85363433-f258-4568-9ad9-2ecf259d9538 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:51.242256 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-85363433-f258-4568-9ad9-2ecf259d9538 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:51.242865 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-85363433-f258-4568-9ad9-2ecf259d9538 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:51.243847 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-85363433-f258-4568-9ad9-2ecf259d9538 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:51.244418 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-85363433-f258-4568-9ad9-2ecf259d9538 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:51.399908 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-85363433-f258-4568-9ad9-2ecf259d9538 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:51.408542 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-85363433-f258-4568-9ad9-2ecf259d9538 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1514 microversion: 2.1 time: 0.182089 Jul 07 07:28:51.409734 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 496/974] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:28:51 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:28:52.427487 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e24a029e-f0de-464b-87e3-206eb7e0c003 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:52.434606 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-e893447e-540d-4ccd-8277-dc8c697cc486 req-c1e657ab-cd94-49b3-9622-2f84b96c84da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9", "name": "network-vif-deleted", "tag": "92420e26-ab65-4d06-b6c4-68e65c1ba976"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:28:52.435209 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e24a029e-f0de-464b-87e3-206eb7e0c003 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:52.442442 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e24a029e-f0de-464b-87e3-206eb7e0c003 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:52.443314 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e24a029e-f0de-464b-87e3-206eb7e0c003 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:52.444305 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e893447e-540d-4ccd-8277-dc8c697cc486 req-c1e657ab-cd94-49b3-9622-2f84b96c84da service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:52.444541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e24a029e-f0de-464b-87e3-206eb7e0c003 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:52.444808 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-e893447e-540d-4ccd-8277-dc8c697cc486 req-c1e657ab-cd94-49b3-9622-2f84b96c84da service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:52.445153 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e24a029e-f0de-464b-87e3-206eb7e0c003 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:52.459384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-e893447e-540d-4ccd-8277-dc8c697cc486 req-c1e657ab-cd94-49b3-9622-2f84b96c84da service nova] Creating event network-vif-deleted:92420e26-ab65-4d06-b6c4-68e65c1ba976 for instance 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 on hv-cinder-82660 Jul 07 07:28:52.465395 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-e893447e-540d-4ccd-8277-dc8c697cc486 req-c1e657ab-cd94-49b3-9622-2f84b96c84da service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035015 Jul 07 07:28:52.466462 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 497/975] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:28:52.523440 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e24a029e-f0de-464b-87e3-206eb7e0c003 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:28:52.534636 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e24a029e-f0de-464b-87e3-206eb7e0c003 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 200 len: 1472 microversion: 2.1 time: 0.111228 Jul 07 07:28:52.539276 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 479/976] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:28:52 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 1472 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:28:53.552255 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-48037bca-2c0b-415b-9256-bc81ab2c4a18 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:28:53.552978 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-48037bca-2c0b-415b-9256-bc81ab2c4a18 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:28:53.560740 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48037bca-2c0b-415b-9256-bc81ab2c4a18 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:53.561204 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48037bca-2c0b-415b-9256-bc81ab2c4a18 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:53.562029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48037bca-2c0b-415b-9256-bc81ab2c4a18 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:28:53.562470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-48037bca-2c0b-415b-9256-bc81ab2c4a18 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:28:53.577322 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-48037bca-2c0b-415b-9256-bc81ab2c4a18 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] HTTP exception thrown: Instance 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 could not be found. Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-48037bca-2c0b-415b-9256-bc81ab2c4a18 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Request method failure captured: Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 HTTP/1.1 Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixoru5jWw__yr7YTwcuZliO_QeHpL8OhvBpw8MVN0QRXDsgkp76evJ-9SgfPGIDtT4Y5_7uzpfsqdA_HgmugTZTRT_pbiOpNlYsW5DswiCWabav3WKbi57NTe1n6lGVWQBbVMwkC5SR_kJ0yCm8iBENm9E54wVSjtjPCQN6BpXHbo06Y Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 322cc6f4005b49f1889dcc6dca8043f2 Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotTestJSON-71248067 Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:28:53.579054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/322cc6f4005b49f1889dcc6dca8043f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/322cc6f4005b49f1889dcc6dca8043f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_322cc6f4005b49f1889dcc6dca8043f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/322cc6f4005b49f1889dcc6dca8043f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotTestJSON-71248067 Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 322cc6f4005b49f1889dcc6dca8043f2 Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-71248067 Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotTestJSON-71248067-project Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: ba90d232c52145288745a765f6131023 Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotTestJSON-71248067-project Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 could not be found. Jul 07 07:28:53.580819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9'} Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 could not be found. Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:28:53.582109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 could not be found. Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 could not be found. Jul 07 07:28:53.584625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:28:53.586421 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-48037bca-2c0b-415b-9256-bc81ab2c4a18 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Returning 404 to user: Instance 4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:28:53.586421 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-48037bca-2c0b-415b-9256-bc81ab2c4a18 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9" status: 404 len: 111 microversion: 2.1 time: 0.032929 Jul 07 07:28:53.586421 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 498/977] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:28:53 2022] GET /compute/v2.1/servers/4a44e4ed-9d30-4c8b-b853-1b7ece93f4b9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:29:05.664251 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1964568765", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452", "networks": [{"uuid": "a3b1f934-d744-4e19-a3e3-92112b05545b"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:29:05.671566 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:05.672772 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:05.719492 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] validate_networks() for [('a3b1f934-d744-4e19-a3e3-92112b05545b', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:29:06.199435 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:29:06.199936 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:29:06.200885 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:29:06.201424 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:29:06.201934 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:29:06.213602 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:06.214199 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:06.215292 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:06.215839 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:06.236155 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Getting quotas for project 322cc6f4005b49f1889dcc6dca8043f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:29:06.240482 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Getting quotas for user ba90d232c52145288745a765f6131023 and project 322cc6f4005b49f1889dcc6dca8043f2. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:29:06.258612 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:29:06.262395 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:29:06.313559 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cd45bb47-d9a7-4689-8ee2-6050d1d8ea26 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654227 Jul 07 07:29:06.315130 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 480/978] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:29:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:29:06.327671 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-419b4299-4576-49c7-a457-fee42fab048e tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:06.339194 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-419b4299-4576-49c7-a457-fee42fab048e tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:06.344232 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:06.345320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:06.444478 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-419b4299-4576-49c7-a457-fee42fab048e tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:06.453473 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-419b4299-4576-49c7-a457-fee42fab048e tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1219 microversion: 2.1 time: 0.131499 Jul 07 07:29:06.454796 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 499/979] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:06 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:07.473464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-11c6aca3-b40b-4400-8938-95be70ddb0f5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:07.474240 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-11c6aca3-b40b-4400-8938-95be70ddb0f5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:07.484497 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11c6aca3-b40b-4400-8938-95be70ddb0f5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:07.484953 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11c6aca3-b40b-4400-8938-95be70ddb0f5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:07.485781 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11c6aca3-b40b-4400-8938-95be70ddb0f5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:07.486223 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-11c6aca3-b40b-4400-8938-95be70ddb0f5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:07.525343 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-45627926", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-820613128", "security_groups": [{"name": "tempest-secgroup-smoke-23811377"}], "block_device_mapping_v2": [{"uuid": "346e8d3f-e62f-444b-8899-4a13007dc26f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ee189ac2-defb-4ca0-922f-ad677527f6e6"}]}} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:29:07.600955 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-11c6aca3-b40b-4400-8938-95be70ddb0f5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:07.625483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-11c6aca3-b40b-4400-8938-95be70ddb0f5 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1279 microversion: 2.1 time: 0.140162 Jul 07 07:29:07.626507 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 481/980] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:07 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:29:07.704005 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.network.neutron [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] validate_networks() for [('ee189ac2-defb-4ca0-922f-ad677527f6e6', None, None, None, None, None)] {{(pid=117787) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:29:08.182109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Flavor limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:29:08.182546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Image limits 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:29:08.183753 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Flavor pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:29:08.184297 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Image pref 0:0:0 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:29:08.184825 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.virt.hardware [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117787) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:29:08.196038 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:08.196508 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:08.197339 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:08.198805 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:08.218945 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Getting quotas for project aafd6d9a6d134f538a61498790991c0c. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:29:08.223508 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.quota [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Getting quotas for user 63d931e360f94cf78880ec2f2970a066 and project aafd6d9a6d134f538a61498790991c0c. Resources: {'cores', 'instances', 'ram'} {{(pid=117787) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:29:08.300652 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Going to run 1 instances... {{(pid=117787) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:29:08.303297 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='346e8d3f-e62f-444b-8899-4a13007dc26f',volume_size=None,volume_type=None)] {{(pid=117787) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:29:08.482002 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-68201d17-2a7e-42c3-ade7-31f43815c26f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.960858 Jul 07 07:29:08.488475 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 500/981] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:29:07 2022] POST /compute/v2.1/servers => generated 404 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:29:08.493916 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-3fa957f6-204d-499d-b694-ab8f91c846fc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:08.494602 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-3fa957f6-204d-499d-b694-ab8f91c846fc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:08.571186 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-3fa957f6-204d-499d-b694-ab8f91c846fc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:08.580945 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-3fa957f6-204d-499d-b694-ab8f91c846fc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1092 microversion: 2.1 time: 0.090326 Jul 07 07:29:08.582090 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 482/982] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:08 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1092 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:08.644658 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-cbea1a89-54e7-4765-a42a-b9440c5a14b7 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:08.645326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-cbea1a89-54e7-4765-a42a-b9440c5a14b7 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:08.653346 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbea1a89-54e7-4765-a42a-b9440c5a14b7 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:08.654014 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbea1a89-54e7-4765-a42a-b9440c5a14b7 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:08.655054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbea1a89-54e7-4765-a42a-b9440c5a14b7 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:08.655706 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-cbea1a89-54e7-4765-a42a-b9440c5a14b7 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:08.822877 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-cbea1a89-54e7-4765-a42a-b9440c5a14b7 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:08.832392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-cbea1a89-54e7-4765-a42a-b9440c5a14b7 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1319 microversion: 2.1 time: 0.193179 Jul 07 07:29:08.843062 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 501/983] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:08 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:09.081098 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-20314be7-586e-4aee-ae53-284bc78ff9ad req-38571982-1d89-47a4-97cc-a247ad7c4f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "960a4f4d-2039-4994-90b6-46115abb8cd8", "tag": "d6ca475e-3d53-4083-a6a3-1eae6592741a"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:29:09.101024 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-20314be7-586e-4aee-ae53-284bc78ff9ad req-38571982-1d89-47a4-97cc-a247ad7c4f16 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:09.101939 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-20314be7-586e-4aee-ae53-284bc78ff9ad req-38571982-1d89-47a4-97cc-a247ad7c4f16 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:09.117296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-20314be7-586e-4aee-ae53-284bc78ff9ad req-38571982-1d89-47a4-97cc-a247ad7c4f16 service nova] Creating event network-changed:d6ca475e-3d53-4083-a6a3-1eae6592741a for instance 960a4f4d-2039-4994-90b6-46115abb8cd8 on hv-cinder-82660 Jul 07 07:29:09.123403 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-20314be7-586e-4aee-ae53-284bc78ff9ad req-38571982-1d89-47a4-97cc-a247ad7c4f16 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046037 Jul 07 07:29:09.124511 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 483/984] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:29:09.598934 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1dfbc0f2-e0db-47d8-88f8-9b61a2d04fa8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:09.599610 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1dfbc0f2-e0db-47d8-88f8-9b61a2d04fa8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:09.606266 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1dfbc0f2-e0db-47d8-88f8-9b61a2d04fa8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:09.606717 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1dfbc0f2-e0db-47d8-88f8-9b61a2d04fa8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:09.607503 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1dfbc0f2-e0db-47d8-88f8-9b61a2d04fa8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:09.607938 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1dfbc0f2-e0db-47d8-88f8-9b61a2d04fa8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:09.673329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1dfbc0f2-e0db-47d8-88f8-9b61a2d04fa8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:09.682479 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1dfbc0f2-e0db-47d8-88f8-9b61a2d04fa8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1190 microversion: 2.1 time: 0.087130 Jul 07 07:29:09.682818 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 502/985] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:09 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1190 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:09.851278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-d45501bb-86c4-4b80-b7d3-f748516edf52 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:09.851990 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-d45501bb-86c4-4b80-b7d3-f748516edf52 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:09.863888 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d45501bb-86c4-4b80-b7d3-f748516edf52 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:09.864642 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d45501bb-86c4-4b80-b7d3-f748516edf52 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:09.865854 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d45501bb-86c4-4b80-b7d3-f748516edf52 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:09.866453 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-d45501bb-86c4-4b80-b7d3-f748516edf52 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:10.006156 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-d45501bb-86c4-4b80-b7d3-f748516edf52 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:10.013790 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-d45501bb-86c4-4b80-b7d3-f748516edf52 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1319 microversion: 2.1 time: 0.167365 Jul 07 07:29:10.014351 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 484/986] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:09 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:10.701664 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ee705988-f17c-4c6e-8c3f-774bdb68eebe tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:10.702427 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ee705988-f17c-4c6e-8c3f-774bdb68eebe tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:10.711832 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee705988-f17c-4c6e-8c3f-774bdb68eebe tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:10.712464 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee705988-f17c-4c6e-8c3f-774bdb68eebe tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:10.713577 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee705988-f17c-4c6e-8c3f-774bdb68eebe tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:10.714174 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ee705988-f17c-4c6e-8c3f-774bdb68eebe tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:10.792047 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ee705988-f17c-4c6e-8c3f-774bdb68eebe tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:10.799713 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ee705988-f17c-4c6e-8c3f-774bdb68eebe tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1208 microversion: 2.1 time: 0.103479 Jul 07 07:29:10.800347 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 503/987] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:10 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1208 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:11.036795 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0131cf81-01e3-4257-b6e8-66163ce829ab tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:11.037587 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0131cf81-01e3-4257-b6e8-66163ce829ab tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:11.045447 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0131cf81-01e3-4257-b6e8-66163ce829ab tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:11.045447 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0131cf81-01e3-4257-b6e8-66163ce829ab tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:11.045447 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0131cf81-01e3-4257-b6e8-66163ce829ab tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:11.045447 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0131cf81-01e3-4257-b6e8-66163ce829ab tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:11.245459 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0131cf81-01e3-4257-b6e8-66163ce829ab tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:11.254728 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0131cf81-01e3-4257-b6e8-66163ce829ab tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1319 microversion: 2.1 time: 0.222362 Jul 07 07:29:11.255340 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 485/988] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:11 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:11.818249 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d1ed887f-93f2-4c49-b87d-db3fc9fb5925 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:11.818806 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d1ed887f-93f2-4c49-b87d-db3fc9fb5925 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:11.825797 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d1ed887f-93f2-4c49-b87d-db3fc9fb5925 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:11.826507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d1ed887f-93f2-4c49-b87d-db3fc9fb5925 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:11.827294 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d1ed887f-93f2-4c49-b87d-db3fc9fb5925 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:11.827728 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d1ed887f-93f2-4c49-b87d-db3fc9fb5925 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:11.900806 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d1ed887f-93f2-4c49-b87d-db3fc9fb5925 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:11.908678 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d1ed887f-93f2-4c49-b87d-db3fc9fb5925 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1196 microversion: 2.1 time: 0.094722 Jul 07 07:29:11.909610 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 504/989] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:11 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1196 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:12.275070 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-016260de-fb3d-4600-9cd2-1c9e4523b22f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:12.276554 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-016260de-fb3d-4600-9cd2-1c9e4523b22f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:12.284471 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-016260de-fb3d-4600-9cd2-1c9e4523b22f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:12.284965 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-016260de-fb3d-4600-9cd2-1c9e4523b22f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:12.285760 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-016260de-fb3d-4600-9cd2-1c9e4523b22f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:12.286329 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-016260de-fb3d-4600-9cd2-1c9e4523b22f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:12.434666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-016260de-fb3d-4600-9cd2-1c9e4523b22f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:12.442778 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-016260de-fb3d-4600-9cd2-1c9e4523b22f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1319 microversion: 2.1 time: 0.173222 Jul 07 07:29:12.444057 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 486/990] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:12 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:12.749695 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-1f5c9292-08b8-4df6-8130-e770dbbab9e0 req-f0c2fa84-a31e-4834-9b3b-0d9e6c4481b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66306d61-37aa-44d9-a9c0-cf1d1f778708", "tag": "d2fe24c8-4606-44dd-bd17-d1e9a7a4d8ed"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:29:12.760034 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1f5c9292-08b8-4df6-8130-e770dbbab9e0 req-f0c2fa84-a31e-4834-9b3b-0d9e6c4481b7 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:12.760757 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-1f5c9292-08b8-4df6-8130-e770dbbab9e0 req-f0c2fa84-a31e-4834-9b3b-0d9e6c4481b7 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:12.778867 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-1f5c9292-08b8-4df6-8130-e770dbbab9e0 req-f0c2fa84-a31e-4834-9b3b-0d9e6c4481b7 service nova] Creating event network-changed:d2fe24c8-4606-44dd-bd17-d1e9a7a4d8ed for instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 on hv-cinder-82660 Jul 07 07:29:12.784707 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-1f5c9292-08b8-4df6-8130-e770dbbab9e0 req-f0c2fa84-a31e-4834-9b3b-0d9e6c4481b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039109 Jul 07 07:29:12.786003 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 505/991] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:29:12.927001 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c7b59db3-30e0-4bbd-8341-3bd8982d1a88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:12.927843 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c7b59db3-30e0-4bbd-8341-3bd8982d1a88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:12.948081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7b59db3-30e0-4bbd-8341-3bd8982d1a88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:12.948533 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7b59db3-30e0-4bbd-8341-3bd8982d1a88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:12.949327 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7b59db3-30e0-4bbd-8341-3bd8982d1a88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:12.949936 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c7b59db3-30e0-4bbd-8341-3bd8982d1a88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:13.087389 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c7b59db3-30e0-4bbd-8341-3bd8982d1a88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:13.096203 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c7b59db3-30e0-4bbd-8341-3bd8982d1a88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.172988 Jul 07 07:29:13.096917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 487/992] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:12 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:13.463566 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b355ff2f-482d-4058-a2a1-d7482076ac59 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:13.464292 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b355ff2f-482d-4058-a2a1-d7482076ac59 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:13.471206 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b355ff2f-482d-4058-a2a1-d7482076ac59 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:13.471652 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b355ff2f-482d-4058-a2a1-d7482076ac59 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:13.472417 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b355ff2f-482d-4058-a2a1-d7482076ac59 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:13.472839 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b355ff2f-482d-4058-a2a1-d7482076ac59 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:13.611233 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-b355ff2f-482d-4058-a2a1-d7482076ac59 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:13.619572 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b355ff2f-482d-4058-a2a1-d7482076ac59 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1319 microversion: 2.1 time: 0.161280 Jul 07 07:29:13.620150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 506/993] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:13 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:14.113819 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b749226d-5653-48ec-b86e-31db0ebc2e57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:14.114650 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b749226d-5653-48ec-b86e-31db0ebc2e57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:14.121835 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b749226d-5653-48ec-b86e-31db0ebc2e57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:14.122283 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b749226d-5653-48ec-b86e-31db0ebc2e57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:14.123052 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b749226d-5653-48ec-b86e-31db0ebc2e57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:14.123477 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b749226d-5653-48ec-b86e-31db0ebc2e57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:14.257584 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b749226d-5653-48ec-b86e-31db0ebc2e57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:14.269386 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b749226d-5653-48ec-b86e-31db0ebc2e57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.159528 Jul 07 07:29:14.270320 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 488/994] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:14 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:14.638784 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-dfde95aa-a041-414f-977d-20a64711a7ce tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:14.639581 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-dfde95aa-a041-414f-977d-20a64711a7ce tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:14.648996 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dfde95aa-a041-414f-977d-20a64711a7ce tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:14.649642 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dfde95aa-a041-414f-977d-20a64711a7ce tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:14.650661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dfde95aa-a041-414f-977d-20a64711a7ce tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:14.651232 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-dfde95aa-a041-414f-977d-20a64711a7ce tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:14.787385 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-dfde95aa-a041-414f-977d-20a64711a7ce tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:14.797734 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-dfde95aa-a041-414f-977d-20a64711a7ce tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1319 microversion: 2.1 time: 0.163952 Jul 07 07:29:14.798444 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 507/995] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:14 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:15.289571 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-90ec519b-d339-4d09-a341-fb5555a78d82 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:15.290420 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-90ec519b-d339-4d09-a341-fb5555a78d82 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:15.298055 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90ec519b-d339-4d09-a341-fb5555a78d82 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:15.298556 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90ec519b-d339-4d09-a341-fb5555a78d82 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:15.299413 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90ec519b-d339-4d09-a341-fb5555a78d82 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:15.299938 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-90ec519b-d339-4d09-a341-fb5555a78d82 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:15.454823 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-90ec519b-d339-4d09-a341-fb5555a78d82 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:15.464629 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-90ec519b-d339-4d09-a341-fb5555a78d82 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.179953 Jul 07 07:29:15.464629 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 489/996] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:15 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:15.817025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a7867ca3-3f33-4264-ac27-865f168c491d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:15.817851 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a7867ca3-3f33-4264-ac27-865f168c491d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:15.827851 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7867ca3-3f33-4264-ac27-865f168c491d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:15.829649 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7867ca3-3f33-4264-ac27-865f168c491d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:15.830920 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7867ca3-3f33-4264-ac27-865f168c491d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:15.831748 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a7867ca3-3f33-4264-ac27-865f168c491d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:15.974057 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a7867ca3-3f33-4264-ac27-865f168c491d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:15.981784 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a7867ca3-3f33-4264-ac27-865f168c491d tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1319 microversion: 2.1 time: 0.169989 Jul 07 07:29:15.982475 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 508/997] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:15 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:16.481263 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-36a84074-a415-4752-b0a7-f5c4283ab55c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:16.482287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-36a84074-a415-4752-b0a7-f5c4283ab55c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:16.484659 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:16.491241 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36a84074-a415-4752-b0a7-f5c4283ab55c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:16.491671 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36a84074-a415-4752-b0a7-f5c4283ab55c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:16.492614 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36a84074-a415-4752-b0a7-f5c4283ab55c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:16.493248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-36a84074-a415-4752-b0a7-f5c4283ab55c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:16.636538 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-36a84074-a415-4752-b0a7-f5c4283ab55c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:16.644329 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-36a84074-a415-4752-b0a7-f5c4283ab55c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.166957 Jul 07 07:29:16.644883 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 490/998] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:16 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:17.003152 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e6c4e69e-4dea-4877-9f6c-856205037c98 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:17.003781 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e6c4e69e-4dea-4877-9f6c-856205037c98 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:17.013260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6c4e69e-4dea-4877-9f6c-856205037c98 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:17.013930 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6c4e69e-4dea-4877-9f6c-856205037c98 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:17.015066 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6c4e69e-4dea-4877-9f6c-856205037c98 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:17.015612 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e6c4e69e-4dea-4877-9f6c-856205037c98 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:17.158793 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e6c4e69e-4dea-4877-9f6c-856205037c98 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:17.170735 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e6c4e69e-4dea-4877-9f6c-856205037c98 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1319 microversion: 2.1 time: 0.173915 Jul 07 07:29:17.171513 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 509/999] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:16 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:17.662048 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ed18eb7d-689d-4513-8fe9-46e715ba4a64 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:17.662717 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ed18eb7d-689d-4513-8fe9-46e715ba4a64 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:17.669692 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed18eb7d-689d-4513-8fe9-46e715ba4a64 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:17.670147 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed18eb7d-689d-4513-8fe9-46e715ba4a64 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:17.670955 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed18eb7d-689d-4513-8fe9-46e715ba4a64 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:17.671414 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ed18eb7d-689d-4513-8fe9-46e715ba4a64 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:17.809964 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ed18eb7d-689d-4513-8fe9-46e715ba4a64 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:17.817763 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ed18eb7d-689d-4513-8fe9-46e715ba4a64 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.160315 Jul 07 07:29:17.818327 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 491/1000] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:17 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:29:18.191272 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-edaba05e-93d5-4371-8619-4978c08bd9f6 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:18.191861 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-edaba05e-93d5-4371-8619-4978c08bd9f6 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:18.198879 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edaba05e-93d5-4371-8619-4978c08bd9f6 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:18.199358 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edaba05e-93d5-4371-8619-4978c08bd9f6 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:18.200152 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edaba05e-93d5-4371-8619-4978c08bd9f6 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:18.200661 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-edaba05e-93d5-4371-8619-4978c08bd9f6 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:18.216999 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:18.232837 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=8 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:18.243666 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-945babdd-1d51-4164-9e7b-b89112dc7ac6 req-b115cff1-89f4-4f05-9cf3-1e54c487368d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960a4f4d-2039-4994-90b6-46115abb8cd8", "name": "network-vif-plugged", "status": "completed", "tag": "d6ca475e-3d53-4083-a6a3-1eae6592741a"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:29:18.252912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-945babdd-1d51-4164-9e7b-b89112dc7ac6 req-b115cff1-89f4-4f05-9cf3-1e54c487368d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:18.253505 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-945babdd-1d51-4164-9e7b-b89112dc7ac6 req-b115cff1-89f4-4f05-9cf3-1e54c487368d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:18.266686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-945babdd-1d51-4164-9e7b-b89112dc7ac6 req-b115cff1-89f4-4f05-9cf3-1e54c487368d service nova] Creating event network-vif-plugged:d6ca475e-3d53-4083-a6a3-1eae6592741a for instance 960a4f4d-2039-4994-90b6-46115abb8cd8 on hv-cinder-82660 Jul 07 07:29:18.271949 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-945babdd-1d51-4164-9e7b-b89112dc7ac6 req-b115cff1-89f4-4f05-9cf3-1e54c487368d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031993 Jul 07 07:29:18.272889 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 492/1001] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:29:18.348572 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-edaba05e-93d5-4371-8619-4978c08bd9f6 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:18.356074 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-edaba05e-93d5-4371-8619-4978c08bd9f6 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1319 microversion: 2.1 time: 0.168896 Jul 07 07:29:18.356668 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 510/1002] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:18 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:18.832014 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=8 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:18.838204 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fa52aa44-caee-48e1-a715-5b7fc1bfdda8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:18.838904 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fa52aa44-caee-48e1-a715-5b7fc1bfdda8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:18.845810 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa52aa44-caee-48e1-a715-5b7fc1bfdda8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:18.846256 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa52aa44-caee-48e1-a715-5b7fc1bfdda8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:18.847043 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa52aa44-caee-48e1-a715-5b7fc1bfdda8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:18.847485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fa52aa44-caee-48e1-a715-5b7fc1bfdda8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:18.989564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fa52aa44-caee-48e1-a715-5b7fc1bfdda8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:18.998447 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fa52aa44-caee-48e1-a715-5b7fc1bfdda8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.167372 Jul 07 07:29:18.999350 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 493/1003] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:18 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:19.372437 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-aab079cb-7275-46b0-82c6-4a96f5112ada tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:19.373060 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-aab079cb-7275-46b0-82c6-4a96f5112ada tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:19.380334 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aab079cb-7275-46b0-82c6-4a96f5112ada tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:19.380795 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aab079cb-7275-46b0-82c6-4a96f5112ada tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:19.381620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aab079cb-7275-46b0-82c6-4a96f5112ada tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:19.382059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-aab079cb-7275-46b0-82c6-4a96f5112ada tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:19.539697 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-aab079cb-7275-46b0-82c6-4a96f5112ada tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:19.547427 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-aab079cb-7275-46b0-82c6-4a96f5112ada tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1319 microversion: 2.1 time: 0.178976 Jul 07 07:29:19.548024 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 511/1004] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:19 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:20.018530 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-792c1fd6-d8de-4132-b980-98a2eb63b4d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:20.019163 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-792c1fd6-d8de-4132-b980-98a2eb63b4d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:20.027464 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-792c1fd6-d8de-4132-b980-98a2eb63b4d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:20.027904 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-792c1fd6-d8de-4132-b980-98a2eb63b4d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:20.028681 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-792c1fd6-d8de-4132-b980-98a2eb63b4d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:20.029122 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-792c1fd6-d8de-4132-b980-98a2eb63b4d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:20.170949 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-792c1fd6-d8de-4132-b980-98a2eb63b4d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:20.178883 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-792c1fd6-d8de-4132-b980-98a2eb63b4d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.166199 Jul 07 07:29:20.182201 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 494/1005] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:20 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:20.565329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f96b1853-859a-4e3b-b64a-3a087e29786f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:20.565953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f96b1853-859a-4e3b-b64a-3a087e29786f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:20.572702 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f96b1853-859a-4e3b-b64a-3a087e29786f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:20.573262 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f96b1853-859a-4e3b-b64a-3a087e29786f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:20.574028 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f96b1853-859a-4e3b-b64a-3a087e29786f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:20.574465 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f96b1853-859a-4e3b-b64a-3a087e29786f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:20.716837 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f96b1853-859a-4e3b-b64a-3a087e29786f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:20.734177 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f96b1853-859a-4e3b-b64a-3a087e29786f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1507 microversion: 2.1 time: 0.172390 Jul 07 07:29:20.735001 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 512/1006] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:20 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:20.751969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7c14f653-d0e3-4de1-b29e-6e468bbaef8f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51c74261-dc9b-4204-bd79-d9423eff9849", "device": "/dev/sdb"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:29:20.753086 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7c14f653-d0e3-4de1-b29e-6e468bbaef8f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:20.759720 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c14f653-d0e3-4de1-b29e-6e468bbaef8f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:20.760197 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c14f653-d0e3-4de1-b29e-6e468bbaef8f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:20.760959 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c14f653-d0e3-4de1-b29e-6e468bbaef8f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:20.761491 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7c14f653-d0e3-4de1-b29e-6e468bbaef8f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:21.060867 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7c14f653-d0e3-4de1-b29e-6e468bbaef8f tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "POST /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312958 Jul 07 07:29:21.061951 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 495/1007] 10.222.0.62 () {60 vars in 1322 bytes} [Thu Jul 7 07:29:20 2022] POST /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:29:21.197587 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-106205c3-6ddf-4b6e-9018-d7ba7d9b86e3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:21.198170 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-106205c3-6ddf-4b6e-9018-d7ba7d9b86e3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:21.204326 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-106205c3-6ddf-4b6e-9018-d7ba7d9b86e3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:21.204796 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-106205c3-6ddf-4b6e-9018-d7ba7d9b86e3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:21.205584 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-106205c3-6ddf-4b6e-9018-d7ba7d9b86e3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:21.205995 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-106205c3-6ddf-4b6e-9018-d7ba7d9b86e3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:21.398153 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-106205c3-6ddf-4b6e-9018-d7ba7d9b86e3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:21.415465 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-106205c3-6ddf-4b6e-9018-d7ba7d9b86e3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.221823 Jul 07 07:29:21.417079 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 513/1008] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:21 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:22.435508 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-03b8ead3-12dc-417e-babe-474d7bdc4635 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:22.436218 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-03b8ead3-12dc-417e-babe-474d7bdc4635 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:22.443339 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-03b8ead3-12dc-417e-babe-474d7bdc4635 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:22.443783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-03b8ead3-12dc-417e-babe-474d7bdc4635 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:22.444561 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-03b8ead3-12dc-417e-babe-474d7bdc4635 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:22.445026 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-03b8ead3-12dc-417e-babe-474d7bdc4635 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:22.640347 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-03b8ead3-12dc-417e-babe-474d7bdc4635 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:22.650879 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-03b8ead3-12dc-417e-babe-474d7bdc4635 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.219702 Jul 07 07:29:22.651469 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 496/1009] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:22 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:23.673767 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-205347f9-40ea-4fba-a6d3-2a727e2d6ad7 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:23.674910 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-205347f9-40ea-4fba-a6d3-2a727e2d6ad7 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:23.683616 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-205347f9-40ea-4fba-a6d3-2a727e2d6ad7 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:23.684084 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-205347f9-40ea-4fba-a6d3-2a727e2d6ad7 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:23.684884 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-205347f9-40ea-4fba-a6d3-2a727e2d6ad7 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:23.685457 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-205347f9-40ea-4fba-a6d3-2a727e2d6ad7 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:23.832677 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-205347f9-40ea-4fba-a6d3-2a727e2d6ad7 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:23.842103 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-205347f9-40ea-4fba-a6d3-2a727e2d6ad7 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.173593 Jul 07 07:29:23.843059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 514/1010] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:23 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:24.860691 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-06ca1129-f8a3-43a2-8e64-2248bd9606e2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:24.861294 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-06ca1129-f8a3-43a2-8e64-2248bd9606e2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:24.868826 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06ca1129-f8a3-43a2-8e64-2248bd9606e2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:24.869367 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06ca1129-f8a3-43a2-8e64-2248bd9606e2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:24.870154 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06ca1129-f8a3-43a2-8e64-2248bd9606e2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:24.870564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06ca1129-f8a3-43a2-8e64-2248bd9606e2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:25.018151 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-06ca1129-f8a3-43a2-8e64-2248bd9606e2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:25.025748 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-06ca1129-f8a3-43a2-8e64-2248bd9606e2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.169622 Jul 07 07:29:25.026609 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 497/1011] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:24 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:26.045096 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-78efa077-3878-48c2-a5bc-9a3f6e5e6023 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:26.045771 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-78efa077-3878-48c2-a5bc-9a3f6e5e6023 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:26.053380 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-78efa077-3878-48c2-a5bc-9a3f6e5e6023 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:26.053863 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-78efa077-3878-48c2-a5bc-9a3f6e5e6023 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:26.054795 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-78efa077-3878-48c2-a5bc-9a3f6e5e6023 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:26.055236 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-78efa077-3878-48c2-a5bc-9a3f6e5e6023 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:26.204920 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-78efa077-3878-48c2-a5bc-9a3f6e5e6023 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:26.213106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-78efa077-3878-48c2-a5bc-9a3f6e5e6023 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.172301 Jul 07 07:29:26.222613 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 515/1012] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:26 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:26.299463 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-944d6c56-eb80-4438-8107-78cb8fd629c6 req-78f35189-926f-416e-b3e0-9b1a843406e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66306d61-37aa-44d9-a9c0-cf1d1f778708", "name": "network-vif-plugged", "status": "completed", "tag": "d2fe24c8-4606-44dd-bd17-d1e9a7a4d8ed"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:29:26.309490 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-944d6c56-eb80-4438-8107-78cb8fd629c6 req-78f35189-926f-416e-b3e0-9b1a843406e3 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:26.310028 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-944d6c56-eb80-4438-8107-78cb8fd629c6 req-78f35189-926f-416e-b3e0-9b1a843406e3 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:26.315246 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:26.324845 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-944d6c56-eb80-4438-8107-78cb8fd629c6 req-78f35189-926f-416e-b3e0-9b1a843406e3 service nova] Creating event network-vif-plugged:d2fe24c8-4606-44dd-bd17-d1e9a7a4d8ed for instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 on hv-cinder-82660 Jul 07 07:29:26.330874 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-944d6c56-eb80-4438-8107-78cb8fd629c6 req-78f35189-926f-416e-b3e0-9b1a843406e3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036194 Jul 07 07:29:26.331567 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 498/1013] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:29:27.232319 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2c81402a-8586-445c-882e-f7a933176ed0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:27.232959 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2c81402a-8586-445c-882e-f7a933176ed0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:27.241744 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c81402a-8586-445c-882e-f7a933176ed0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:27.242430 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c81402a-8586-445c-882e-f7a933176ed0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:27.243616 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c81402a-8586-445c-882e-f7a933176ed0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:27.244228 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2c81402a-8586-445c-882e-f7a933176ed0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:27.396060 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2c81402a-8586-445c-882e-f7a933176ed0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:27.405121 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2c81402a-8586-445c-882e-f7a933176ed0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1262 microversion: 2.1 time: 0.177357 Jul 07 07:29:27.405737 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 516/1014] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:27 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1262 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:28.424066 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-06180095-e489-4dd4-ae3c-b0e8cf258e91 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:28.424756 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-06180095-e489-4dd4-ae3c-b0e8cf258e91 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:28.432866 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06180095-e489-4dd4-ae3c-b0e8cf258e91 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:28.433335 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06180095-e489-4dd4-ae3c-b0e8cf258e91 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:28.434085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06180095-e489-4dd4-ae3c-b0e8cf258e91 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:28.434545 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-06180095-e489-4dd4-ae3c-b0e8cf258e91 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:28.585390 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-06180095-e489-4dd4-ae3c-b0e8cf258e91 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:28.594988 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-06180095-e489-4dd4-ae3c-b0e8cf258e91 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1448 microversion: 2.1 time: 0.175724 Jul 07 07:29:28.595724 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 499/1015] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:28 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1448 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:28.612869 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-969fa1f8-748d-4324-8fce-e3f30305b572 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:28.614161 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-969fa1f8-748d-4324-8fce-e3f30305b572 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:28.621433 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-969fa1f8-748d-4324-8fce-e3f30305b572 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:28.622102 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-969fa1f8-748d-4324-8fce-e3f30305b572 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:28.622884 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-969fa1f8-748d-4324-8fce-e3f30305b572 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:28.623329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-969fa1f8-748d-4324-8fce-e3f30305b572 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:28.762210 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-969fa1f8-748d-4324-8fce-e3f30305b572 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:28.765689 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=100 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:28.770560 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-969fa1f8-748d-4324-8fce-e3f30305b572 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1448 microversion: 2.1 time: 0.161927 Jul 07 07:29:28.771162 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 517/1016] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:28 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:30.674028 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-76d4c7d6-1068-4b55-9c93-06424f704457 req-aafdeab4-5b7d-4541-b643-ec2e536294ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66306d61-37aa-44d9-a9c0-cf1d1f778708", "tag": "d2fe24c8-4606-44dd-bd17-d1e9a7a4d8ed"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:29:30.683604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-76d4c7d6-1068-4b55-9c93-06424f704457 req-aafdeab4-5b7d-4541-b643-ec2e536294ae service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:30.684053 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-76d4c7d6-1068-4b55-9c93-06424f704457 req-aafdeab4-5b7d-4541-b643-ec2e536294ae service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:30.697941 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-76d4c7d6-1068-4b55-9c93-06424f704457 req-aafdeab4-5b7d-4541-b643-ec2e536294ae service nova] Creating event network-changed:d2fe24c8-4606-44dd-bd17-d1e9a7a4d8ed for instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 on hv-cinder-82660 Jul 07 07:29:30.703740 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-76d4c7d6-1068-4b55-9c93-06424f704457 req-aafdeab4-5b7d-4541-b643-ec2e536294ae service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033478 Jul 07 07:29:30.704709 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 500/1017] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:29:41.595205 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c427ae31-63ed-4bc2-ab80-66473351f4de tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:41.595856 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c427ae31-63ed-4bc2-ab80-66473351f4de tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:41.598061 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:41.604234 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c427ae31-63ed-4bc2-ab80-66473351f4de tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:41.604828 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c427ae31-63ed-4bc2-ab80-66473351f4de tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:41.605717 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c427ae31-63ed-4bc2-ab80-66473351f4de tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:41.606190 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c427ae31-63ed-4bc2-ab80-66473351f4de tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:41.697151 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-c427ae31-63ed-4bc2-ab80-66473351f4de tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lazy-loading 'services' on Instance uuid 960a4f4d-2039-4994-90b6-46115abb8cd8 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:29:41.777944 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c427ae31-63ed-4bc2-ab80-66473351f4de tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "DELETE /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8/os-volume_attachments/51c74261-dc9b-4204-bd79-d9423eff9849" status: 202 len: 0 microversion: 2.1 time: 0.187414 Jul 07 07:29:41.778538 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 518/1018] 10.222.0.62 () {58 vars in 1415 bytes} [Thu Jul 7 07:29:41 2022] DELETE /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8/os-volume_attachments/51c74261-dc9b-4204-bd79-d9423eff9849 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:29:42.902391 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4f3e7f60-2949-4f46-8e24-380cb856b1fa tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:42.902964 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4f3e7f60-2949-4f46-8e24-380cb856b1fa tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:42.905640 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:42.906358 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=8 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:29:42.911888 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4f3e7f60-2949-4f46-8e24-380cb856b1fa tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:42.912361 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4f3e7f60-2949-4f46-8e24-380cb856b1fa tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:42.913136 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4f3e7f60-2949-4f46-8e24-380cb856b1fa tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:42.913577 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4f3e7f60-2949-4f46-8e24-380cb856b1fa tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:42.939848 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4f3e7f60-2949-4f46-8e24-380cb856b1fa tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Going to try to terminate instance {{(pid=117788) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:29:43.027105 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4f3e7f60-2949-4f46-8e24-380cb856b1fa tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "DELETE /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 204 len: 0 microversion: 2.1 time: 0.128889 Jul 07 07:29:43.027735 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 501/1019] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:29:42 2022] DELETE /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:29:43.038130 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7543d269-9975-49cd-9c18-7a02af6d7d2a tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:43.039490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7543d269-9975-49cd-9c18-7a02af6d7d2a tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:43.046339 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7543d269-9975-49cd-9c18-7a02af6d7d2a tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:43.046810 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7543d269-9975-49cd-9c18-7a02af6d7d2a tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:43.047703 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7543d269-9975-49cd-9c18-7a02af6d7d2a tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:43.048138 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-7543d269-9975-49cd-9c18-7a02af6d7d2a tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:43.310246 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7543d269-9975-49cd-9c18-7a02af6d7d2a tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:43.318320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7543d269-9975-49cd-9c18-7a02af6d7d2a tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1513 microversion: 2.1 time: 0.285851 Jul 07 07:29:43.318912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 519/1020] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:43 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:44.338616 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1057a024-cc85-45f9-a2d8-d8c21d292705 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:44.339333 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1057a024-cc85-45f9-a2d8-d8c21d292705 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:44.348168 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1057a024-cc85-45f9-a2d8-d8c21d292705 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:44.349014 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1057a024-cc85-45f9-a2d8-d8c21d292705 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:44.350531 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1057a024-cc85-45f9-a2d8-d8c21d292705 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:44.351124 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1057a024-cc85-45f9-a2d8-d8c21d292705 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:44.505867 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1057a024-cc85-45f9-a2d8-d8c21d292705 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:44.515629 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1057a024-cc85-45f9-a2d8-d8c21d292705 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1513 microversion: 2.1 time: 0.182832 Jul 07 07:29:44.516426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 502/1021] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:44 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1513 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:45.436448 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-7ed1229d-c1b1-4d00-9547-5d614c68f6df req-51ecedaf-b3e3-452d-9f60-a0a3445ae3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "960a4f4d-2039-4994-90b6-46115abb8cd8", "name": "network-vif-deleted", "tag": "d6ca475e-3d53-4083-a6a3-1eae6592741a"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:29:45.447950 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-7ed1229d-c1b1-4d00-9547-5d614c68f6df req-51ecedaf-b3e3-452d-9f60-a0a3445ae3f8 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:45.448287 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-7ed1229d-c1b1-4d00-9547-5d614c68f6df req-51ecedaf-b3e3-452d-9f60-a0a3445ae3f8 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:45.461555 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-7ed1229d-c1b1-4d00-9547-5d614c68f6df req-51ecedaf-b3e3-452d-9f60-a0a3445ae3f8 service nova] Creating event network-vif-deleted:d6ca475e-3d53-4083-a6a3-1eae6592741a for instance 960a4f4d-2039-4994-90b6-46115abb8cd8 on hv-cinder-82660 Jul 07 07:29:45.467198 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-7ed1229d-c1b1-4d00-9547-5d614c68f6df req-51ecedaf-b3e3-452d-9f60-a0a3445ae3f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034928 Jul 07 07:29:45.467815 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 520/1022] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:29:45.535160 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:45.536432 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:45.545130 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:45.545651 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:45.546641 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:45.547902 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:45.582855 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:45.583310 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:45.584030 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.objects.instance [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lazy-loading 'fault' on Instance uuid 960a4f4d-2039-4994-90b6-46115abb8cd8 {{(pid=117788) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:29:45.628002 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba90d232c52145288745a765f6131023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322cc6f4005b49f1889dcc6dca8043f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:29:45.636207 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ebe47de6-af94-4b54-bed6-f650d5cfdddf tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 200 len: 1309 microversion: 2.1 time: 0.105912 Jul 07 07:29:45.636770 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 503/1023] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:45 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:29:46.654599 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3edaad6a-799c-4b71-a0b4-61f3570ff775 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:29:46.655197 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-3edaad6a-799c-4b71-a0b4-61f3570ff775 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] [instance: 960a4f4d-2039-4994-90b6-46115abb8cd8] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:29:46.663146 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3edaad6a-799c-4b71-a0b4-61f3570ff775 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:46.663732 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3edaad6a-799c-4b71-a0b4-61f3570ff775 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:46.664535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3edaad6a-799c-4b71-a0b4-61f3570ff775 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:29:46.664986 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-3edaad6a-799c-4b71-a0b4-61f3570ff775 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:29:46.679903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-3edaad6a-799c-4b71-a0b4-61f3570ff775 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] HTTP exception thrown: Instance 960a4f4d-2039-4994-90b6-46115abb8cd8 could not be found. Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3edaad6a-799c-4b71-a0b4-61f3570ff775 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Request method failure captured: Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 HTTP/1.1 Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixoru5jWw__yr7YTwcuZliO_QeHpL8OhvBpw8MVN0QRXDsgkp76evJ-9SgfPGIDtT4Y5_7uzpfsqdA_HgmugTZTRT_pbiOpNlYsW5DswiCWabav3WKbi57NTe1n6lGVWQBbVMwkC5SR_kJ0yCm8iBENm9E54wVSjtjPCQN6BpXHbo06Y Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: 322cc6f4005b49f1889dcc6dca8043f2 Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-VolumesSnapshotTestJSON-71248067 Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:29:46.681973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/322cc6f4005b49f1889dcc6dca8043f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/322cc6f4005b49f1889dcc6dca8043f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_322cc6f4005b49f1889dcc6dca8043f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/322cc6f4005b49f1889dcc6dca8043f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-VolumesSnapshotTestJSON-71248067 Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: 322cc6f4005b49f1889dcc6dca8043f2 Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-71248067 Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-VolumesSnapshotTestJSON-71248067-project Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: ba90d232c52145288745a765f6131023 Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-VolumesSnapshotTestJSON-71248067-project Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 960a4f4d-2039-4994-90b6-46115abb8cd8 could not be found. Jul 07 07:29:46.684000 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '960a4f4d-2039-4994-90b6-46115abb8cd8'} Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 960a4f4d-2039-4994-90b6-46115abb8cd8 could not be found. Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:29:46.685200 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 960a4f4d-2039-4994-90b6-46115abb8cd8 could not be found. Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 960a4f4d-2039-4994-90b6-46115abb8cd8 could not be found. Jul 07 07:29:46.686998 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:29:46.688648 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-3edaad6a-799c-4b71-a0b4-61f3570ff775 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] Returning 404 to user: Instance 960a4f4d-2039-4994-90b6-46115abb8cd8 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:29:46.688648 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-3edaad6a-799c-4b71-a0b4-61f3570ff775 tempest-VolumesSnapshotTestJSON-71248067 tempest-VolumesSnapshotTestJSON-71248067-project] 10.222.0.62 "GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8" status: 404 len: 111 microversion: 2.1 time: 0.033293 Jul 07 07:29:46.688648 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 521/1024] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:29:46 2022] GET /compute/v2.1/servers/960a4f4d-2039-4994-90b6-46115abb8cd8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:30:05.934639 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1440135357", "imageRef": "cc34d359-2ef0-44fb-850a-9d9bfe590465", "flavorRef": "452"}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:30:05.942510 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:05.943217 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:06.183201 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] validate_networks() for None {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:30:06.483204 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:30:06.483949 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:30:06.484789 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:30:06.485232 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:30:06.485770 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:30:06.496346 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:06.496790 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:06.497618 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:06.498047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:06.516323 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Getting quotas for project d8abca76d27949458c35fa47aee8196c. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:30:06.520903 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Getting quotas for user cda50f3332bc48b3a32a7b849afa3c97 and project d8abca76d27949458c35fa47aee8196c. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:30:06.533604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:30:06.535905 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc34d359-2ef0-44fb-850a-9d9bfe590465',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:30:06.585178 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-10db5623-f724-4bb6-8d66-de64ec398507 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654746 Jul 07 07:30:06.585887 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 504/1025] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:30:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:30:06.597791 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-37b65993-bba6-424f-b095-9db466506fc4 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:06.598640 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-37b65993-bba6-424f-b095-9db466506fc4 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:06.602486 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=8 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:06.603265 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:06.786155 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-37b65993-bba6-424f-b095-9db466506fc4 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:06.793952 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-37b65993-bba6-424f-b095-9db466506fc4 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1215 microversion: 2.1 time: 0.200600 Jul 07 07:30:06.794656 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 522/1026] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:06 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:07.812352 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4fd67c1c-f9ab-459a-98eb-7a133fe148bd tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:07.813052 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4fd67c1c-f9ab-459a-98eb-7a133fe148bd tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:07.820128 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fd67c1c-f9ab-459a-98eb-7a133fe148bd tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:07.820580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fd67c1c-f9ab-459a-98eb-7a133fe148bd tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:07.821371 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fd67c1c-f9ab-459a-98eb-7a133fe148bd tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:07.821810 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4fd67c1c-f9ab-459a-98eb-7a133fe148bd tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:07.895268 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4fd67c1c-f9ab-459a-98eb-7a133fe148bd tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:07.903263 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4fd67c1c-f9ab-459a-98eb-7a133fe148bd tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1273 microversion: 2.1 time: 0.095724 Jul 07 07:30:07.903838 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 505/1027] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:07 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:30:08.920156 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1c71072b-de58-4ae6-9715-f30cfe120522 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:08.920893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1c71072b-de58-4ae6-9715-f30cfe120522 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:08.928354 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c71072b-de58-4ae6-9715-f30cfe120522 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:08.928793 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c71072b-de58-4ae6-9715-f30cfe120522 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:08.929611 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c71072b-de58-4ae6-9715-f30cfe120522 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:08.930684 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1c71072b-de58-4ae6-9715-f30cfe120522 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:09.084711 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1c71072b-de58-4ae6-9715-f30cfe120522 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:09.092327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1c71072b-de58-4ae6-9715-f30cfe120522 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1315 microversion: 2.1 time: 0.176067 Jul 07 07:30:09.093043 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 523/1028] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:08 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:09.426306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-6f063f9a-b368-458e-b135-837c4deb0c58 req-dfc347d0-a2ed-4781-86a5-7ad9fcdb307e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5991645-45c8-4a7a-925c-45e596dc4ba2", "tag": "8959b214-2c2a-42a7-84e7-37f024b5a41f"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:30:09.435985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-6f063f9a-b368-458e-b135-837c4deb0c58 req-dfc347d0-a2ed-4781-86a5-7ad9fcdb307e service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:09.436686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-6f063f9a-b368-458e-b135-837c4deb0c58 req-dfc347d0-a2ed-4781-86a5-7ad9fcdb307e service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:09.449656 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-6f063f9a-b368-458e-b135-837c4deb0c58 req-dfc347d0-a2ed-4781-86a5-7ad9fcdb307e service nova] Creating event network-changed:8959b214-2c2a-42a7-84e7-37f024b5a41f for instance b5991645-45c8-4a7a-925c-45e596dc4ba2 on hv-cinder-82660 Jul 07 07:30:09.458653 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-6f063f9a-b368-458e-b135-837c4deb0c58 req-dfc347d0-a2ed-4781-86a5-7ad9fcdb307e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037006 Jul 07 07:30:09.460295 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 506/1029] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:30:10.109625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-da85d118-b576-46d2-958a-a55a01199b5c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:10.110384 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-da85d118-b576-46d2-958a-a55a01199b5c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:10.117538 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da85d118-b576-46d2-958a-a55a01199b5c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:10.117910 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da85d118-b576-46d2-958a-a55a01199b5c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:10.118679 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da85d118-b576-46d2-958a-a55a01199b5c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:10.119105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-da85d118-b576-46d2-958a-a55a01199b5c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:10.274435 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-da85d118-b576-46d2-958a-a55a01199b5c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:10.284731 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-da85d118-b576-46d2-958a-a55a01199b5c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1315 microversion: 2.1 time: 0.178944 Jul 07 07:30:10.291750 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 524/1030] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:10 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:11.302828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e02756db-3ed9-4659-9d82-6c8c7d206724 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:11.303532 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e02756db-3ed9-4659-9d82-6c8c7d206724 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:11.311593 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e02756db-3ed9-4659-9d82-6c8c7d206724 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:11.312417 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e02756db-3ed9-4659-9d82-6c8c7d206724 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:11.313996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e02756db-3ed9-4659-9d82-6c8c7d206724 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:11.314698 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e02756db-3ed9-4659-9d82-6c8c7d206724 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:11.485742 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e02756db-3ed9-4659-9d82-6c8c7d206724 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:11.495020 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e02756db-3ed9-4659-9d82-6c8c7d206724 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1315 microversion: 2.1 time: 0.196726 Jul 07 07:30:11.495652 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 507/1031] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:11 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:12.512599 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6408ab5d-c434-4fb8-aefa-f93516c603bc tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:12.513205 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6408ab5d-c434-4fb8-aefa-f93516c603bc tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:12.520743 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6408ab5d-c434-4fb8-aefa-f93516c603bc tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:12.521188 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6408ab5d-c434-4fb8-aefa-f93516c603bc tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:12.522105 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6408ab5d-c434-4fb8-aefa-f93516c603bc tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:12.522539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6408ab5d-c434-4fb8-aefa-f93516c603bc tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:12.686950 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6408ab5d-c434-4fb8-aefa-f93516c603bc tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:12.695189 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6408ab5d-c434-4fb8-aefa-f93516c603bc tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1315 microversion: 2.1 time: 0.186622 Jul 07 07:30:12.695760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 525/1032] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:12 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:13.712698 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-64c814f5-bb91-47bc-8224-2242ffaa1f86 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:13.713330 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-64c814f5-bb91-47bc-8224-2242ffaa1f86 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:13.720429 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64c814f5-bb91-47bc-8224-2242ffaa1f86 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:13.720871 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64c814f5-bb91-47bc-8224-2242ffaa1f86 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:13.721674 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64c814f5-bb91-47bc-8224-2242ffaa1f86 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:13.722103 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-64c814f5-bb91-47bc-8224-2242ffaa1f86 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:14.018188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-64c814f5-bb91-47bc-8224-2242ffaa1f86 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:14.025985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-64c814f5-bb91-47bc-8224-2242ffaa1f86 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1315 microversion: 2.1 time: 0.317287 Jul 07 07:30:14.026543 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 508/1033] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:13 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:14.529789 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-744d2616-809e-496a-a4bd-086c175d8808 req-26b1e364-6c93-4a92-99c2-d3ab7248d4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5991645-45c8-4a7a-925c-45e596dc4ba2", "name": "network-vif-plugged", "status": "completed", "tag": "8959b214-2c2a-42a7-84e7-37f024b5a41f"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:30:14.539469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-744d2616-809e-496a-a4bd-086c175d8808 req-26b1e364-6c93-4a92-99c2-d3ab7248d4a2 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:14.539913 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-744d2616-809e-496a-a4bd-086c175d8808 req-26b1e364-6c93-4a92-99c2-d3ab7248d4a2 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:14.551552 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-744d2616-809e-496a-a4bd-086c175d8808 req-26b1e364-6c93-4a92-99c2-d3ab7248d4a2 service nova] Creating event network-vif-plugged:8959b214-2c2a-42a7-84e7-37f024b5a41f for instance b5991645-45c8-4a7a-925c-45e596dc4ba2 on hv-cinder-82660 Jul 07 07:30:14.556900 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-744d2616-809e-496a-a4bd-086c175d8808 req-26b1e364-6c93-4a92-99c2-d3ab7248d4a2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030585 Jul 07 07:30:14.557703 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 526/1034] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:30:15.043468 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fe7f709c-3b2d-461b-ab62-25554cfac215 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:15.044065 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fe7f709c-3b2d-461b-ab62-25554cfac215 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:15.051348 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fe7f709c-3b2d-461b-ab62-25554cfac215 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:15.051792 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fe7f709c-3b2d-461b-ab62-25554cfac215 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:15.052558 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fe7f709c-3b2d-461b-ab62-25554cfac215 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:15.052985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fe7f709c-3b2d-461b-ab62-25554cfac215 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:15.203840 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fe7f709c-3b2d-461b-ab62-25554cfac215 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:15.211815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fe7f709c-3b2d-461b-ab62-25554cfac215 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1315 microversion: 2.1 time: 0.172268 Jul 07 07:30:15.212383 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 509/1035] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:15 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:16.230193 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d23167e6-b61b-4770-987a-71dbafd410a8 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:16.230878 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d23167e6-b61b-4770-987a-71dbafd410a8 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:16.238545 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d23167e6-b61b-4770-987a-71dbafd410a8 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:16.238991 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d23167e6-b61b-4770-987a-71dbafd410a8 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:16.239776 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d23167e6-b61b-4770-987a-71dbafd410a8 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:16.240209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d23167e6-b61b-4770-987a-71dbafd410a8 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:16.392734 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-d23167e6-b61b-4770-987a-71dbafd410a8 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:16.401197 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d23167e6-b61b-4770-987a-71dbafd410a8 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1315 microversion: 2.1 time: 0.175744 Jul 07 07:30:16.402084 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 527/1036] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:16 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:17.423924 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0c8ef734-f796-4b71-934c-bc38e12bc066 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:17.424672 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0c8ef734-f796-4b71-934c-bc38e12bc066 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:17.427704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:17.428342 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:17.435523 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8ef734-f796-4b71-934c-bc38e12bc066 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:17.436004 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8ef734-f796-4b71-934c-bc38e12bc066 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:17.436840 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8ef734-f796-4b71-934c-bc38e12bc066 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:17.437406 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0c8ef734-f796-4b71-934c-bc38e12bc066 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:17.589604 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0c8ef734-f796-4b71-934c-bc38e12bc066 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:17.597526 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0c8ef734-f796-4b71-934c-bc38e12bc066 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1464 microversion: 2.1 time: 0.178537 Jul 07 07:30:17.598086 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 510/1037] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:17 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1464 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:30:17.650240 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-35a10313-7243-48b1-b7f8-abacf3340d93 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:17.650790 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-35a10313-7243-48b1-b7f8-abacf3340d93 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:17.653864 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:30:17.661872 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35a10313-7243-48b1-b7f8-abacf3340d93 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:17.662210 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35a10313-7243-48b1-b7f8-abacf3340d93 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:17.663392 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35a10313-7243-48b1-b7f8-abacf3340d93 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:17.663981 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-35a10313-7243-48b1-b7f8-abacf3340d93 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:17.693658 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-35a10313-7243-48b1-b7f8-abacf3340d93 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:30:17.787485 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-35a10313-7243-48b1-b7f8-abacf3340d93 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 204 len: 0 microversion: 2.1 time: 0.143068 Jul 07 07:30:17.788121 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 528/1038] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:30:17 2022] DELETE /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:30:17.796796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1c03baf3-2673-4764-98d1-33d03db45a21 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:17.797474 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1c03baf3-2673-4764-98d1-33d03db45a21 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:17.803688 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c03baf3-2673-4764-98d1-33d03db45a21 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:17.804133 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c03baf3-2673-4764-98d1-33d03db45a21 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:17.804894 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c03baf3-2673-4764-98d1-33d03db45a21 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:17.805332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1c03baf3-2673-4764-98d1-33d03db45a21 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:17.953274 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1c03baf3-2673-4764-98d1-33d03db45a21 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:17.964896 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1c03baf3-2673-4764-98d1-33d03db45a21 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1470 microversion: 2.1 time: 0.171703 Jul 07 07:30:17.965749 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 511/1039] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:17 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:18.985625 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-82f18ac0-7a8d-4bba-b87d-336fe3c9e96a tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:18.986323 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-82f18ac0-7a8d-4bba-b87d-336fe3c9e96a tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:18.993755 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82f18ac0-7a8d-4bba-b87d-336fe3c9e96a tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:18.994167 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82f18ac0-7a8d-4bba-b87d-336fe3c9e96a tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:18.994985 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82f18ac0-7a8d-4bba-b87d-336fe3c9e96a tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:18.995401 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-82f18ac0-7a8d-4bba-b87d-336fe3c9e96a tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:19.150598 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-82f18ac0-7a8d-4bba-b87d-336fe3c9e96a tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:19.161825 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-82f18ac0-7a8d-4bba-b87d-336fe3c9e96a tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1470 microversion: 2.1 time: 0.180478 Jul 07 07:30:19.162585 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 529/1040] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:18 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:19.885476 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-e1902557-c8e6-4032-8daf-3676cce9e77f req-afc97f10-76ec-4eb5-a407-c04dc73767a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5991645-45c8-4a7a-925c-45e596dc4ba2", "name": "network-vif-deleted", "tag": "8959b214-2c2a-42a7-84e7-37f024b5a41f"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:30:19.894840 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e1902557-c8e6-4032-8daf-3676cce9e77f req-afc97f10-76ec-4eb5-a407-c04dc73767a3 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:19.895366 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-e1902557-c8e6-4032-8daf-3676cce9e77f req-afc97f10-76ec-4eb5-a407-c04dc73767a3 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:19.907281 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-e1902557-c8e6-4032-8daf-3676cce9e77f req-afc97f10-76ec-4eb5-a407-c04dc73767a3 service nova] Creating event network-vif-deleted:8959b214-2c2a-42a7-84e7-37f024b5a41f for instance b5991645-45c8-4a7a-925c-45e596dc4ba2 on hv-cinder-82660 Jul 07 07:30:19.913013 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-e1902557-c8e6-4032-8daf-3676cce9e77f req-afc97f10-76ec-4eb5-a407-c04dc73767a3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031269 Jul 07 07:30:19.913647 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 512/1041] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:30:20.184687 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:20.185290 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:20.192570 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:20.193063 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:20.193908 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:20.194337 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:20.228520 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:20.228949 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:20.229433 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lazy-loading 'fault' on Instance uuid b5991645-45c8-4a7a-925c-45e596dc4ba2 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:30:20.279415 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cda50f3332bc48b3a32a7b849afa3c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abca76d27949458c35fa47aee8196c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:30:20.287319 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-e9d36145-5996-43d7-bb72-9357d2e982d5 tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 200 len: 1305 microversion: 2.1 time: 0.107099 Jul 07 07:30:20.287872 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 530/1042] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:20 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:30:21.305285 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ca892161-1a8c-4a43-9eff-2ef27255f56c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:30:21.305985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-ca892161-1a8c-4a43-9eff-2ef27255f56c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] [instance: b5991645-45c8-4a7a-925c-45e596dc4ba2] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:30:21.313337 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca892161-1a8c-4a43-9eff-2ef27255f56c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:21.313796 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca892161-1a8c-4a43-9eff-2ef27255f56c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:21.314569 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca892161-1a8c-4a43-9eff-2ef27255f56c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:30:21.315034 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-ca892161-1a8c-4a43-9eff-2ef27255f56c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:30:21.329857 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-ca892161-1a8c-4a43-9eff-2ef27255f56c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] HTTP exception thrown: Instance b5991645-45c8-4a7a-925c-45e596dc4ba2 could not be found. Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ca892161-1a8c-4a43-9eff-2ef27255f56c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Request method failure captured: Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 HTTP/1.1 Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixot8ehNlQRqatwVLcByoKWhs7sDesrIG0x1G6nnGs4OBHb54o-XAZ7Op9Dg_oEsllFhAkJNROtN2GqaB_v86QCBCduQf6h2E-xmafVBc2jfD8Q167dToUiCnDxqzNGdLRmiGu8CDNIDE-9xBogGB5i2vntG34Aqo6sVtO28JsnuhAM0 Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: d8abca76d27949458c35fa47aee8196c Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-VolumesNegativeTest-929683379 Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:30:21.331815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d8abca76d27949458c35fa47aee8196c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/d8abca76d27949458c35fa47aee8196c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_d8abca76d27949458c35fa47aee8196c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/d8abca76d27949458c35fa47aee8196c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-VolumesNegativeTest-929683379 Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: d8abca76d27949458c35fa47aee8196c Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-VolumesNegativeTest-929683379 Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-VolumesNegativeTest-929683379-project Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: cda50f3332bc48b3a32a7b849afa3c97 Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-VolumesNegativeTest-929683379-project Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance b5991645-45c8-4a7a-925c-45e596dc4ba2 could not be found. Jul 07 07:30:21.333564 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': 'b5991645-45c8-4a7a-925c-45e596dc4ba2'} Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5991645-45c8-4a7a-925c-45e596dc4ba2 could not be found. Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:30:21.334485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5991645-45c8-4a7a-925c-45e596dc4ba2 could not be found. Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5991645-45c8-4a7a-925c-45e596dc4ba2 could not be found. Jul 07 07:30:21.335876 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:30:21.337148 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ca892161-1a8c-4a43-9eff-2ef27255f56c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] Returning 404 to user: Instance b5991645-45c8-4a7a-925c-45e596dc4ba2 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:30:21.337148 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ca892161-1a8c-4a43-9eff-2ef27255f56c tempest-VolumesNegativeTest-929683379 tempest-VolumesNegativeTest-929683379-project] 10.222.0.62 "GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2" status: 404 len: 111 microversion: 2.1 time: 0.032895 Jul 07 07:30:21.337148 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 513/1043] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:30:21 2022] GET /compute/v2.1/servers/b5991645-45c8-4a7a-925c-45e596dc4ba2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:31:35.537966 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:35.539198 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:35.544547 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ff31dc27-a35b-4c4a-9803-40c5e27f7333 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:35.545197 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ff31dc27-a35b-4c4a-9803-40c5e27f7333 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:35.553535 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff31dc27-a35b-4c4a-9803-40c5e27f7333 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:35.553977 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff31dc27-a35b-4c4a-9803-40c5e27f7333 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:35.554736 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff31dc27-a35b-4c4a-9803-40c5e27f7333 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:35.555165 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-ff31dc27-a35b-4c4a-9803-40c5e27f7333 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:35.584760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ff31dc27-a35b-4c4a-9803-40c5e27f7333 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:31:35.667222 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ff31dc27-a35b-4c4a-9803-40c5e27f7333 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "DELETE /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 204 len: 0 microversion: 2.1 time: 0.132061 Jul 07 07:31:35.668147 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 531/1044] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:31:35 2022] DELETE /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:31:35.674881 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:35.675611 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=44 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:35.679879 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0833ea0a-7afe-466b-a7ab-481f5e25aed6 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:35.680485 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0833ea0a-7afe-466b-a7ab-481f5e25aed6 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:35.688697 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0833ea0a-7afe-466b-a7ab-481f5e25aed6 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:35.689137 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0833ea0a-7afe-466b-a7ab-481f5e25aed6 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:35.689925 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0833ea0a-7afe-466b-a7ab-481f5e25aed6 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:35.690351 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0833ea0a-7afe-466b-a7ab-481f5e25aed6 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:35.838385 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0833ea0a-7afe-466b-a7ab-481f5e25aed6 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:35.846418 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0833ea0a-7afe-466b-a7ab-481f5e25aed6 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1573 microversion: 2.1 time: 0.173581 Jul 07 07:31:35.846983 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 514/1045] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:35 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:36.868779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-17c1699a-41fc-40d1-8bc4-4614bb86dfc8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:36.869501 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-17c1699a-41fc-40d1-8bc4-4614bb86dfc8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:36.876017 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-17c1699a-41fc-40d1-8bc4-4614bb86dfc8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:36.876471 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-17c1699a-41fc-40d1-8bc4-4614bb86dfc8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:36.877248 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-17c1699a-41fc-40d1-8bc4-4614bb86dfc8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:36.877721 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-17c1699a-41fc-40d1-8bc4-4614bb86dfc8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:37.013638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-17c1699a-41fc-40d1-8bc4-4614bb86dfc8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:37.021976 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-17c1699a-41fc-40d1-8bc4-4614bb86dfc8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1573 microversion: 2.1 time: 0.157621 Jul 07 07:31:37.022551 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 532/1046] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:36 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:38.040685 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-dd78aa58-a6ae-4e67-9da9-be73b2c9d6b3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:38.041299 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-dd78aa58-a6ae-4e67-9da9-be73b2c9d6b3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:38.050156 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd78aa58-a6ae-4e67-9da9-be73b2c9d6b3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:38.050638 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd78aa58-a6ae-4e67-9da9-be73b2c9d6b3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:38.051602 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd78aa58-a6ae-4e67-9da9-be73b2c9d6b3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:38.052202 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-dd78aa58-a6ae-4e67-9da9-be73b2c9d6b3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:38.195088 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-dd78aa58-a6ae-4e67-9da9-be73b2c9d6b3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:38.203089 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-dd78aa58-a6ae-4e67-9da9-be73b2c9d6b3 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1573 microversion: 2.1 time: 0.167092 Jul 07 07:31:38.203685 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 515/1047] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:38 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:38.964022 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-3eeb5fa5-cee6-405d-bad6-db29cdea53c9 req-c8df035d-8be1-4ffd-9df2-7d10a24eb9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66306d61-37aa-44d9-a9c0-cf1d1f778708", "name": "network-vif-deleted", "tag": "d2fe24c8-4606-44dd-bd17-d1e9a7a4d8ed"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:31:38.972605 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-3eeb5fa5-cee6-405d-bad6-db29cdea53c9 req-c8df035d-8be1-4ffd-9df2-7d10a24eb9ea service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:38.973052 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-3eeb5fa5-cee6-405d-bad6-db29cdea53c9 req-c8df035d-8be1-4ffd-9df2-7d10a24eb9ea service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:38.984360 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-3eeb5fa5-cee6-405d-bad6-db29cdea53c9 req-c8df035d-8be1-4ffd-9df2-7d10a24eb9ea service nova] Creating event network-vif-deleted:d2fe24c8-4606-44dd-bd17-d1e9a7a4d8ed for instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 on hv-cinder-82660 Jul 07 07:31:38.989469 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-3eeb5fa5-cee6-405d-bad6-db29cdea53c9 req-c8df035d-8be1-4ffd-9df2-7d10a24eb9ea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158859 Jul 07 07:31:38.990070 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 533/1048] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:31:39.220368 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b1eef5a3-5e57-4c99-8abf-aa452634db9b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:39.221075 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b1eef5a3-5e57-4c99-8abf-aa452634db9b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:39.228926 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1eef5a3-5e57-4c99-8abf-aa452634db9b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:39.229582 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1eef5a3-5e57-4c99-8abf-aa452634db9b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:39.230532 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1eef5a3-5e57-4c99-8abf-aa452634db9b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:39.231067 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b1eef5a3-5e57-4c99-8abf-aa452634db9b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:39.304078 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b1eef5a3-5e57-4c99-8abf-aa452634db9b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:39.314183 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b1eef5a3-5e57-4c99-8abf-aa452634db9b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 200 len: 1223 microversion: 2.1 time: 0.097252 Jul 07 07:31:39.315483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 516/1049] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:39 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:40.334891 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-950f9e0c-fb5d-4a34-b375-25209a8ec0d9 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:40.335543 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-950f9e0c-fb5d-4a34-b375-25209a8ec0d9 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:40.342280 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-950f9e0c-fb5d-4a34-b375-25209a8ec0d9 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:40.342740 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-950f9e0c-fb5d-4a34-b375-25209a8ec0d9 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:40.343617 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-950f9e0c-fb5d-4a34-b375-25209a8ec0d9 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:40.344054 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-950f9e0c-fb5d-4a34-b375-25209a8ec0d9 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:40.362288 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-950f9e0c-fb5d-4a34-b375-25209a8ec0d9 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] HTTP exception thrown: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-950f9e0c-fb5d-4a34-b375-25209a8ec0d9 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Request method failure captured: Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 HTTP/1.1 Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixosXv1hTCG-ejh-vETmNHt4xW1uqrQ38U3yQiGuzT2ex8GwV-oDeMpvd9cqWCHnRAA85AwP3EBRIcxBW2B_uKGj71rnhF-i2V7s-fECSnnecoeNp1aAY5JNNEcMqJSGlhAfaYTMzKsotNuxDoaKrEPstbcVevo0PO0m9Pw5BDylEIUw Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: aafd6d9a6d134f538a61498790991c0c Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:31:40.364114 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: aafd6d9a6d134f538a61498790991c0c Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-TestVolumeBootPattern-1826107771-project Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 63d931e360f94cf78880ec2f2970a066 Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestVolumeBootPattern-1826107771-project Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:31:40.366029 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '66306d61-37aa-44d9-a9c0-cf1d1f778708'} Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:31:40.367106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:31:40.368760 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:31:40.370251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-950f9e0c-fb5d-4a34-b375-25209a8ec0d9 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Returning 404 to user: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:31:40.370251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-950f9e0c-fb5d-4a34-b375-25209a8ec0d9 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 404 len: 111 microversion: 2.1 time: 0.035895 Jul 07 07:31:40.370251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 534/1050] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:40 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:31:40.470120 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-520838764", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-820613128", "security_groups": [{"name": "tempest-secgroup-smoke-23811377"}], "block_device_mapping_v2": [{"uuid": "346e8d3f-e62f-444b-8899-4a13007dc26f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ee189ac2-defb-4ca0-922f-ad677527f6e6"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:31:40.590284 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] validate_networks() for [('ee189ac2-defb-4ca0-922f-ad677527f6e6', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:31:41.003077 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:31:41.003529 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:31:41.004063 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:31:41.004847 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:31:41.004847 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:31:41.014396 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:41.014844 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:41.015633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:41.016082 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:41.033467 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Getting quotas for project aafd6d9a6d134f538a61498790991c0c. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:31:41.037611 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Getting quotas for user 63d931e360f94cf78880ec2f2970a066 and project aafd6d9a6d134f538a61498790991c0c. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:31:41.097664 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:31:41.099772 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='346e8d3f-e62f-444b-8899-4a13007dc26f',volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:31:41.244960 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-67a44130-a8f8-4f3f-9c1f-767ab71d68d1 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.778832 Jul 07 07:31:41.245643 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 517/1051] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:31:40 2022] POST /compute/v2.1/servers => generated 404 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:31:41.256025 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-ce7e99f2-c7dd-44a9-90a6-c65c1653b41b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:41.256796 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-ce7e99f2-c7dd-44a9-90a6-c65c1653b41b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:41.313319 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-ce7e99f2-c7dd-44a9-90a6-c65c1653b41b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:41.320534 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-ce7e99f2-c7dd-44a9-90a6-c65c1653b41b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1093 microversion: 2.1 time: 0.068542 Jul 07 07:31:41.321145 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 535/1052] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:41 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 07 07:31:42.339169 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-355d6774-be70-4a2c-89ee-1f2e6f70e64d tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:42.339798 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-355d6774-be70-4a2c-89ee-1f2e6f70e64d tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:42.398276 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-355d6774-be70-4a2c-89ee-1f2e6f70e64d tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:42.405381 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-355d6774-be70-4a2c-89ee-1f2e6f70e64d tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1093 microversion: 2.1 time: 0.071082 Jul 07 07:31:42.406178 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 518/1053] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:42 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:43.423799 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-bda29c1b-d85c-46e0-b5c9-cd550f439b79 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:43.424415 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-bda29c1b-d85c-46e0-b5c9-cd550f439b79 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:43.479264 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-bda29c1b-d85c-46e0-b5c9-cd550f439b79 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:43.487062 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-bda29c1b-d85c-46e0-b5c9-cd550f439b79 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1093 microversion: 2.1 time: 0.067303 Jul 07 07:31:43.487493 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 536/1054] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:43 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:44.505047 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5af125c9-5443-46c5-9677-e7674c235a56 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:44.505670 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5af125c9-5443-46c5-9677-e7674c235a56 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:44.567888 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5af125c9-5443-46c5-9677-e7674c235a56 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:44.578318 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5af125c9-5443-46c5-9677-e7674c235a56 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1093 microversion: 2.1 time: 0.077014 Jul 07 07:31:44.579169 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 519/1055] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:44 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:45.596651 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-80a08f63-fa3f-4acc-8fac-53d59910a855 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:45.597287 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-80a08f63-fa3f-4acc-8fac-53d59910a855 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:45.604899 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-80a08f63-fa3f-4acc-8fac-53d59910a855 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:45.605494 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-80a08f63-fa3f-4acc-8fac-53d59910a855 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:45.606322 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-80a08f63-fa3f-4acc-8fac-53d59910a855 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:45.606798 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-80a08f63-fa3f-4acc-8fac-53d59910a855 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:45.675546 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-80a08f63-fa3f-4acc-8fac-53d59910a855 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:45.687804 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-80a08f63-fa3f-4acc-8fac-53d59910a855 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1143 microversion: 2.1 time: 0.095711 Jul 07 07:31:45.688643 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 537/1056] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:45 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1143 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:46.709935 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b9681c12-3270-48f6-a527-dac795611c43 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:46.710596 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b9681c12-3270-48f6-a527-dac795611c43 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:46.718121 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9681c12-3270-48f6-a527-dac795611c43 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:46.718403 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9681c12-3270-48f6-a527-dac795611c43 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:46.719221 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9681c12-3270-48f6-a527-dac795611c43 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:46.719658 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b9681c12-3270-48f6-a527-dac795611c43 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:46.786300 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b9681c12-3270-48f6-a527-dac795611c43 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:46.794177 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b9681c12-3270-48f6-a527-dac795611c43 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1209 microversion: 2.1 time: 0.088131 Jul 07 07:31:46.794761 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 520/1057] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:46 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:47.817749 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f722e151-1da3-48ff-b18e-a3bf948a7943 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:47.818374 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f722e151-1da3-48ff-b18e-a3bf948a7943 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:47.825870 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f722e151-1da3-48ff-b18e-a3bf948a7943 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:47.826324 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f722e151-1da3-48ff-b18e-a3bf948a7943 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:47.827171 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f722e151-1da3-48ff-b18e-a3bf948a7943 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:47.827835 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f722e151-1da3-48ff-b18e-a3bf948a7943 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:47.969616 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f722e151-1da3-48ff-b18e-a3bf948a7943 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:47.977716 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f722e151-1da3-48ff-b18e-a3bf948a7943 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.163831 Jul 07 07:31:47.978295 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 538/1058] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:47 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:47.996297 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-0d2eb3f2-26b3-4ad3-b2c8-4fcf094f0774 req-d4f2fa98-ab23-4086-beab-e23ec975b610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c", "tag": "0fb99e77-9a43-4db0-98a1-5a9a172cd230"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:31:48.020647 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-0d2eb3f2-26b3-4ad3-b2c8-4fcf094f0774 req-d4f2fa98-ab23-4086-beab-e23ec975b610 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:48.023971 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-0d2eb3f2-26b3-4ad3-b2c8-4fcf094f0774 req-d4f2fa98-ab23-4086-beab-e23ec975b610 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:48.044675 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-0d2eb3f2-26b3-4ad3-b2c8-4fcf094f0774 req-d4f2fa98-ab23-4086-beab-e23ec975b610 service nova] Creating event network-changed:0fb99e77-9a43-4db0-98a1-5a9a172cd230 for instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c on hv-cinder-82660 Jul 07 07:31:48.050372 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-0d2eb3f2-26b3-4ad3-b2c8-4fcf094f0774 req-d4f2fa98-ab23-4086-beab-e23ec975b610 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058918 Jul 07 07:31:48.051175 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 521/1059] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:31:48.995726 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-5714bb14-fd37-4201-925a-26e9d65e316f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:48.996314 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-5714bb14-fd37-4201-925a-26e9d65e316f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:49.003773 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5714bb14-fd37-4201-925a-26e9d65e316f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:49.004240 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5714bb14-fd37-4201-925a-26e9d65e316f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:49.005036 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5714bb14-fd37-4201-925a-26e9d65e316f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:49.005513 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-5714bb14-fd37-4201-925a-26e9d65e316f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:49.151722 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-5714bb14-fd37-4201-925a-26e9d65e316f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:49.160190 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-5714bb14-fd37-4201-925a-26e9d65e316f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.168327 Jul 07 07:31:49.160814 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 539/1060] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:48 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:50.179109 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-b6c09951-ed62-4938-89e3-95206b93fb62 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:50.179985 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-b6c09951-ed62-4938-89e3-95206b93fb62 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:50.187217 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b6c09951-ed62-4938-89e3-95206b93fb62 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:50.187673 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b6c09951-ed62-4938-89e3-95206b93fb62 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:50.188457 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b6c09951-ed62-4938-89e3-95206b93fb62 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:50.188892 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-b6c09951-ed62-4938-89e3-95206b93fb62 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:50.347325 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-b6c09951-ed62-4938-89e3-95206b93fb62 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:50.359006 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-b6c09951-ed62-4938-89e3-95206b93fb62 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.184714 Jul 07 07:31:50.359933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 522/1061] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:50 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:51.377936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1449beed-9c68-4d11-a1ba-b1a68dac8d53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:51.378582 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1449beed-9c68-4d11-a1ba-b1a68dac8d53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:51.385764 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1449beed-9c68-4d11-a1ba-b1a68dac8d53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:51.386254 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1449beed-9c68-4d11-a1ba-b1a68dac8d53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:51.387119 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1449beed-9c68-4d11-a1ba-b1a68dac8d53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:51.387559 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1449beed-9c68-4d11-a1ba-b1a68dac8d53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:51.533351 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1449beed-9c68-4d11-a1ba-b1a68dac8d53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:51.541597 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1449beed-9c68-4d11-a1ba-b1a68dac8d53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.167712 Jul 07 07:31:51.542168 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 540/1062] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:51 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:52.558842 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e833fcdd-9242-4ac7-a24f-a246b8c9be22 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:52.559462 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e833fcdd-9242-4ac7-a24f-a246b8c9be22 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:52.561507 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:52.567292 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e833fcdd-9242-4ac7-a24f-a246b8c9be22 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:52.567734 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e833fcdd-9242-4ac7-a24f-a246b8c9be22 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:52.568510 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e833fcdd-9242-4ac7-a24f-a246b8c9be22 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:52.568937 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e833fcdd-9242-4ac7-a24f-a246b8c9be22 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:52.718789 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-e833fcdd-9242-4ac7-a24f-a246b8c9be22 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:52.726514 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e833fcdd-9242-4ac7-a24f-a246b8c9be22 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.172054 Jul 07 07:31:52.727072 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 523/1063] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:52 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:53.744474 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-a75b48ec-e03f-476c-bcef-71e2e086bb53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:53.745268 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-a75b48ec-e03f-476c-bcef-71e2e086bb53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:53.748042 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=4 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:53.754448 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a75b48ec-e03f-476c-bcef-71e2e086bb53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:53.754897 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a75b48ec-e03f-476c-bcef-71e2e086bb53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:53.755698 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a75b48ec-e03f-476c-bcef-71e2e086bb53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:53.756134 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-a75b48ec-e03f-476c-bcef-71e2e086bb53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:53.900809 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-a75b48ec-e03f-476c-bcef-71e2e086bb53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:53.908586 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-a75b48ec-e03f-476c-bcef-71e2e086bb53 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.168560 Jul 07 07:31:53.909127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 541/1064] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:53 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:54.926263 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0233a09f-6252-4633-bf85-4f090db1967a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:54.926905 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0233a09f-6252-4633-bf85-4f090db1967a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:54.929344 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=10 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:31:54.935909 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0233a09f-6252-4633-bf85-4f090db1967a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:54.936357 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0233a09f-6252-4633-bf85-4f090db1967a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:54.937142 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0233a09f-6252-4633-bf85-4f090db1967a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:54.937603 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0233a09f-6252-4633-bf85-4f090db1967a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:55.082764 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0233a09f-6252-4633-bf85-4f090db1967a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:55.090946 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0233a09f-6252-4633-bf85-4f090db1967a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.168823 Jul 07 07:31:55.091525 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 524/1065] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:54 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:56.108856 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-f4d89a4b-9fc0-42bd-84ed-1c77c9289984 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:56.109538 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-f4d89a4b-9fc0-42bd-84ed-1c77c9289984 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:56.117143 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4d89a4b-9fc0-42bd-84ed-1c77c9289984 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:56.117618 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4d89a4b-9fc0-42bd-84ed-1c77c9289984 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:56.118432 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4d89a4b-9fc0-42bd-84ed-1c77c9289984 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:56.118881 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-f4d89a4b-9fc0-42bd-84ed-1c77c9289984 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:56.264165 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-f4d89a4b-9fc0-42bd-84ed-1c77c9289984 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:56.272792 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-f4d89a4b-9fc0-42bd-84ed-1c77c9289984 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.168034 Jul 07 07:31:56.273408 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 542/1066] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:56 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:57.290426 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7d90d3e0-1312-4cf8-9982-47500d52217b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:57.291105 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7d90d3e0-1312-4cf8-9982-47500d52217b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:57.298398 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d90d3e0-1312-4cf8-9982-47500d52217b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:57.298865 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d90d3e0-1312-4cf8-9982-47500d52217b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:57.299704 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d90d3e0-1312-4cf8-9982-47500d52217b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:57.300123 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7d90d3e0-1312-4cf8-9982-47500d52217b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:57.443644 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7d90d3e0-1312-4cf8-9982-47500d52217b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:57.451601 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7d90d3e0-1312-4cf8-9982-47500d52217b tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.165045 Jul 07 07:31:57.452179 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 525/1067] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:57 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:58.469600 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-2137b346-6caf-4f56-af1f-9858573dc806 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:58.470482 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-2137b346-6caf-4f56-af1f-9858573dc806 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:58.477590 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2137b346-6caf-4f56-af1f-9858573dc806 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:58.478046 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2137b346-6caf-4f56-af1f-9858573dc806 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:58.478834 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2137b346-6caf-4f56-af1f-9858573dc806 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:58.479273 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-2137b346-6caf-4f56-af1f-9858573dc806 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:58.629470 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-2137b346-6caf-4f56-af1f-9858573dc806 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:58.636959 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-2137b346-6caf-4f56-af1f-9858573dc806 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.171745 Jul 07 07:31:58.637556 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 543/1068] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:58 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:31:59.242827 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-ee46c0e3-482f-49c6-a010-41ad2f36b060 req-76c5094f-c6ee-4f26-93ae-bcc909262baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c", "name": "network-vif-plugged", "status": "completed", "tag": "0fb99e77-9a43-4db0-98a1-5a9a172cd230"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:31:59.251276 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ee46c0e3-482f-49c6-a010-41ad2f36b060 req-76c5094f-c6ee-4f26-93ae-bcc909262baa service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:59.251719 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-ee46c0e3-482f-49c6-a010-41ad2f36b060 req-76c5094f-c6ee-4f26-93ae-bcc909262baa service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:59.263028 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-ee46c0e3-482f-49c6-a010-41ad2f36b060 req-76c5094f-c6ee-4f26-93ae-bcc909262baa service nova] Creating event network-vif-plugged:0fb99e77-9a43-4db0-98a1-5a9a172cd230 for instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c on hv-cinder-82660 Jul 07 07:31:59.268335 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-ee46c0e3-482f-49c6-a010-41ad2f36b060 req-76c5094f-c6ee-4f26-93ae-bcc909262baa service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107294 Jul 07 07:31:59.269079 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 526/1069] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:31:59.653641 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-03a72c77-8576-4df7-b01a-49d1c64dc2c0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:31:59.654281 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-03a72c77-8576-4df7-b01a-49d1c64dc2c0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:31:59.661788 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-03a72c77-8576-4df7-b01a-49d1c64dc2c0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:59.662125 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-03a72c77-8576-4df7-b01a-49d1c64dc2c0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:59.662936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-03a72c77-8576-4df7-b01a-49d1c64dc2c0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:31:59.663364 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-03a72c77-8576-4df7-b01a-49d1c64dc2c0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:31:59.801973 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-03a72c77-8576-4df7-b01a-49d1c64dc2c0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:31:59.810212 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-03a72c77-8576-4df7-b01a-49d1c64dc2c0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.160615 Jul 07 07:31:59.810819 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 544/1070] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:31:59 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:32:00.828351 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-7f6d55ac-4393-456e-a2ab-233ef0ec847c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:32:00.829014 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-7f6d55ac-4393-456e-a2ab-233ef0ec847c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:32:00.836863 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f6d55ac-4393-456e-a2ab-233ef0ec847c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:32:00.837415 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f6d55ac-4393-456e-a2ab-233ef0ec847c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:32:00.838179 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f6d55ac-4393-456e-a2ab-233ef0ec847c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:32:00.838632 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-7f6d55ac-4393-456e-a2ab-233ef0ec847c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:32:00.998791 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-7f6d55ac-4393-456e-a2ab-233ef0ec847c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:32:01.007159 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-7f6d55ac-4393-456e-a2ab-233ef0ec847c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1263 microversion: 2.1 time: 0.183037 Jul 07 07:32:01.007755 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 527/1071] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:32:00 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:32:02.029956 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-67e9d733-3612-4526-9799-b4926f9e424f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:32:02.030784 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-67e9d733-3612-4526-9799-b4926f9e424f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:32:02.038228 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67e9d733-3612-4526-9799-b4926f9e424f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:32:02.038677 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67e9d733-3612-4526-9799-b4926f9e424f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:32:02.039462 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67e9d733-3612-4526-9799-b4926f9e424f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:32:02.039901 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-67e9d733-3612-4526-9799-b4926f9e424f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:32:02.181040 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-67e9d733-3612-4526-9799-b4926f9e424f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:32:02.192821 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-67e9d733-3612-4526-9799-b4926f9e424f tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1449 microversion: 2.1 time: 0.166954 Jul 07 07:32:02.193662 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 545/1072] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:32:02 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:32:02.209405 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-cf1024ea-bf53-452b-87b3-dc02010e826c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:32:02.209998 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-cf1024ea-bf53-452b-87b3-dc02010e826c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:32:02.216686 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf1024ea-bf53-452b-87b3-dc02010e826c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:32:02.217123 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf1024ea-bf53-452b-87b3-dc02010e826c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:32:02.217897 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf1024ea-bf53-452b-87b3-dc02010e826c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:32:02.218333 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-cf1024ea-bf53-452b-87b3-dc02010e826c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:32:02.360575 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-cf1024ea-bf53-452b-87b3-dc02010e826c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:32:02.368841 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-cf1024ea-bf53-452b-87b3-dc02010e826c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1449 microversion: 2.1 time: 0.163455 Jul 07 07:32:02.369446 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 528/1073] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:32:02 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1449 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:32:04.075301 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-bed4ad21-b2b1-47b6-b965-8f1cf1bcc4c4 req-c67809cc-0f47-469a-8761-c3d71ffa2f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c", "tag": "0fb99e77-9a43-4db0-98a1-5a9a172cd230"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:32:04.084218 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-bed4ad21-b2b1-47b6-b965-8f1cf1bcc4c4 req-c67809cc-0f47-469a-8761-c3d71ffa2f7c service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:32:04.084656 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-bed4ad21-b2b1-47b6-b965-8f1cf1bcc4c4 req-c67809cc-0f47-469a-8761-c3d71ffa2f7c service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:32:04.095844 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-bed4ad21-b2b1-47b6-b965-8f1cf1bcc4c4 req-c67809cc-0f47-469a-8761-c3d71ffa2f7c service nova] Creating event network-changed:0fb99e77-9a43-4db0-98a1-5a9a172cd230 for instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c on hv-cinder-82660 Jul 07 07:32:04.101060 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-bed4ad21-b2b1-47b6-b965-8f1cf1bcc4c4 req-c67809cc-0f47-469a-8761-c3d71ffa2f7c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029490 Jul 07 07:32:04.101702 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 546/1074] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:32:08.278628 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:32:08.279468 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Thu Jul 7 07:32:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 07:33:37.087376 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:33:37.088646 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Thu Jul 7 07:33:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 07:33:41.280250 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:33:41.281024 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=66 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:33:41.286035 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-791667915", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-820613128", "security_groups": [{"name": "tempest-secgroup-smoke-23811377"}], "block_device_mapping_v2": [{"uuid": "aca36c3c-984d-4e8c-a0f9-3e06c9653528", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ee189ac2-defb-4ca0-922f-ad677527f6e6"}]}} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:33:41.422565 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.network.neutron [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] validate_networks() for [('ee189ac2-defb-4ca0-922f-ad677527f6e6', None, None, None, None, None)] {{(pid=117788) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 07 07:33:41.855513 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Flavor limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 07 07:33:41.855942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Image limits 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 07 07:33:41.856412 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Flavor pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 07 07:33:41.856822 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Image pref 0:0:0 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 07 07:33:41.857248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.virt.hardware [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117788) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 07 07:33:41.872188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:41.872633 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:41.873459 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:41.873888 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:41.890942 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Getting quotas for project aafd6d9a6d134f538a61498790991c0c. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 07 07:33:41.895153 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.quota [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Getting quotas for user 63d931e360f94cf78880ec2f2970a066 and project aafd6d9a6d134f538a61498790991c0c. Resources: {'cores', 'instances', 'ram'} {{(pid=117788) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 07 07:33:41.957544 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Going to run 1 instances... {{(pid=117788) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 07 07:33:41.959797 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aca36c3c-984d-4e8c-a0f9-3e06c9653528',volume_size=None,volume_type=None)] {{(pid=117788) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 07 07:33:42.099017 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-e7f25317-c02c-4189-8306-35eb1a24be95 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.820566 Jul 07 07:33:42.099695 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 529/1075] 10.222.0.62 () {60 vars in 1146 bytes} [Thu Jul 7 07:33:41 2022] POST /compute/v2.1/servers => generated 404 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 07 07:33:42.113665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac3fcaae-9df3-452a-a03c-847e23ebc99b] AMQP server on 10.222.0.62:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 07 07:33:42.114414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:33:42.115207 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:33:42.121122 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-7cbd18d8-a197-4156-a8c4-25f557cadb75 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:42.123285 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-7cbd18d8-a197-4156-a8c4-25f557cadb75 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:42.186943 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-7cbd18d8-a197-4156-a8c4-25f557cadb75 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:42.194403 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-7cbd18d8-a197-4156-a8c4-25f557cadb75 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1093 microversion: 2.1 time: 0.085247 Jul 07 07:33:42.195010 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 547/1076] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:42 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:43.212815 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-c90f21bd-18a4-46d2-b3b3-e8c8de7ba422 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:43.213499 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-c90f21bd-18a4-46d2-b3b3-e8c8de7ba422 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:43.224012 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c90f21bd-18a4-46d2-b3b3-e8c8de7ba422 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:43.224541 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c90f21bd-18a4-46d2-b3b3-e8c8de7ba422 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:43.225520 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c90f21bd-18a4-46d2-b3b3-e8c8de7ba422 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:43.226026 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-c90f21bd-18a4-46d2-b3b3-e8c8de7ba422 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:43.297434 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-c90f21bd-18a4-46d2-b3b3-e8c8de7ba422 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:43.305650 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-c90f21bd-18a4-46d2-b3b3-e8c8de7ba422 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1199 microversion: 2.1 time: 0.097266 Jul 07 07:33:43.306311 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 530/1077] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:43 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:43.818521 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:33:43.818816 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Thu Jul 7 07:33:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 07:33:44.325715 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-323b3f86-0f59-4e0a-83eb-69a2c2f78006 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:44.327155 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-323b3f86-0f59-4e0a-83eb-69a2c2f78006 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:44.335109 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-323b3f86-0f59-4e0a-83eb-69a2c2f78006 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:44.335907 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-323b3f86-0f59-4e0a-83eb-69a2c2f78006 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:44.336700 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-323b3f86-0f59-4e0a-83eb-69a2c2f78006 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:44.337342 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-323b3f86-0f59-4e0a-83eb-69a2c2f78006 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:44.357654 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac3fcaae-9df3-452a-a03c-847e23ebc99b] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 43208. Jul 07 07:33:44.489771 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-323b3f86-0f59-4e0a-83eb-69a2c2f78006 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:44.499602 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-323b3f86-0f59-4e0a-83eb-69a2c2f78006 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.177967 Jul 07 07:33:44.500260 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 548/1078] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:44 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:44.815229 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-7077871a-e43e-491d-90f4-1e5f808019b8 req-dc988d6f-23ec-4b0d-9024-de4d56a82366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4075ace9-a7ae-4ba8-8108-21cf5e1ffb29", "tag": "1d28d474-8d4b-4905-8e13-4060328069b6"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:33:44.839563 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7077871a-e43e-491d-90f4-1e5f808019b8 req-dc988d6f-23ec-4b0d-9024-de4d56a82366 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:44.839996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-7077871a-e43e-491d-90f4-1e5f808019b8 req-dc988d6f-23ec-4b0d-9024-de4d56a82366 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:44.852149 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-7077871a-e43e-491d-90f4-1e5f808019b8 req-dc988d6f-23ec-4b0d-9024-de4d56a82366 service nova] Creating event network-changed:1d28d474-8d4b-4905-8e13-4060328069b6 for instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 on hv-cinder-82660 Jul 07 07:33:44.858287 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-7077871a-e43e-491d-90f4-1e5f808019b8 req-dc988d6f-23ec-4b0d-9024-de4d56a82366 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046929 Jul 07 07:33:44.858938 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 531/1079] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:33:45.518270 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-54bd25b9-769c-4d69-ac00-0a4edf049593 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:45.518931 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-54bd25b9-769c-4d69-ac00-0a4edf049593 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:45.526436 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54bd25b9-769c-4d69-ac00-0a4edf049593 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:45.526892 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54bd25b9-769c-4d69-ac00-0a4edf049593 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:45.527695 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54bd25b9-769c-4d69-ac00-0a4edf049593 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:45.528230 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-54bd25b9-769c-4d69-ac00-0a4edf049593 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:45.672488 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-54bd25b9-769c-4d69-ac00-0a4edf049593 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:45.681612 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-54bd25b9-769c-4d69-ac00-0a4edf049593 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.167774 Jul 07 07:33:45.682213 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 549/1080] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:45 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:46.700934 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-5d98f0a1-7c31-42c1-aa90-8dc443584682 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:46.701678 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-5d98f0a1-7c31-42c1-aa90-8dc443584682 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:46.709332 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d98f0a1-7c31-42c1-aa90-8dc443584682 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:46.709797 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d98f0a1-7c31-42c1-aa90-8dc443584682 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:46.710644 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d98f0a1-7c31-42c1-aa90-8dc443584682 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:46.711085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-5d98f0a1-7c31-42c1-aa90-8dc443584682 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:46.869173 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-5d98f0a1-7c31-42c1-aa90-8dc443584682 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:46.879375 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-5d98f0a1-7c31-42c1-aa90-8dc443584682 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.183278 Jul 07 07:33:46.879933 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 532/1081] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:46 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:47.896903 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-36bd647a-63aa-4a57-8a4c-8c74e3befb37 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:47.897531 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-36bd647a-63aa-4a57-8a4c-8c74e3befb37 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:47.904562 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36bd647a-63aa-4a57-8a4c-8c74e3befb37 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:47.905013 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36bd647a-63aa-4a57-8a4c-8c74e3befb37 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:47.905841 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36bd647a-63aa-4a57-8a4c-8c74e3befb37 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:47.906279 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-36bd647a-63aa-4a57-8a4c-8c74e3befb37 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:48.311006 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-36bd647a-63aa-4a57-8a4c-8c74e3befb37 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:48.319413 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-36bd647a-63aa-4a57-8a4c-8c74e3befb37 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.426357 Jul 07 07:33:48.319987 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 550/1082] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:47 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:49.336584 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-0d28c1e1-3ef9-4c80-8d0f-c0c128206e33 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:49.337192 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-0d28c1e1-3ef9-4c80-8d0f-c0c128206e33 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:49.344846 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d28c1e1-3ef9-4c80-8d0f-c0c128206e33 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:49.345369 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d28c1e1-3ef9-4c80-8d0f-c0c128206e33 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:49.346184 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d28c1e1-3ef9-4c80-8d0f-c0c128206e33 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:49.346619 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-0d28c1e1-3ef9-4c80-8d0f-c0c128206e33 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:49.489249 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-0d28c1e1-3ef9-4c80-8d0f-c0c128206e33 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:49.497626 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-0d28c1e1-3ef9-4c80-8d0f-c0c128206e33 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.164967 Jul 07 07:33:49.498243 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 533/1083] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:49 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:50.516332 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-de9e5ac3-2b17-4707-8bc5-9d9a7b6f9295 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:50.516955 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-de9e5ac3-2b17-4707-8bc5-9d9a7b6f9295 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:50.524421 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de9e5ac3-2b17-4707-8bc5-9d9a7b6f9295 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:50.524912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de9e5ac3-2b17-4707-8bc5-9d9a7b6f9295 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:50.525859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de9e5ac3-2b17-4707-8bc5-9d9a7b6f9295 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:50.526324 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-de9e5ac3-2b17-4707-8bc5-9d9a7b6f9295 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:50.670804 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-de9e5ac3-2b17-4707-8bc5-9d9a7b6f9295 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:50.679320 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-de9e5ac3-2b17-4707-8bc5-9d9a7b6f9295 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.166813 Jul 07 07:33:50.679936 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 551/1084] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:50 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:51.697455 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-1ceda52b-4932-400a-a0e5-6806b528139e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:51.698093 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-1ceda52b-4932-400a-a0e5-6806b528139e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:51.704878 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ceda52b-4932-400a-a0e5-6806b528139e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:51.705393 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ceda52b-4932-400a-a0e5-6806b528139e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:51.706248 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ceda52b-4932-400a-a0e5-6806b528139e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:51.706716 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-1ceda52b-4932-400a-a0e5-6806b528139e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:51.852684 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-1ceda52b-4932-400a-a0e5-6806b528139e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:51.860912 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-1ceda52b-4932-400a-a0e5-6806b528139e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.167596 Jul 07 07:33:51.861555 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 534/1085] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:51 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:52.880711 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6f2cff75-d07f-4add-9d78-b6d84795e73a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:52.881614 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6f2cff75-d07f-4add-9d78-b6d84795e73a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:52.884099 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell0:SELECT=2 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:33:52.890599 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6f2cff75-d07f-4add-9d78-b6d84795e73a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:52.891062 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6f2cff75-d07f-4add-9d78-b6d84795e73a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:52.891888 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6f2cff75-d07f-4add-9d78-b6d84795e73a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:52.892327 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6f2cff75-d07f-4add-9d78-b6d84795e73a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:53.057313 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6f2cff75-d07f-4add-9d78-b6d84795e73a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:53.065893 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6f2cff75-d07f-4add-9d78-b6d84795e73a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.189370 Jul 07 07:33:53.066490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 552/1086] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:52 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:54.083976 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-aede92c8-704d-4b3a-a0ec-3b9ad105f4a0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:54.084693 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-aede92c8-704d-4b3a-a0ec-3b9ad105f4a0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:54.086977 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=2 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:33:54.087486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell0:SELECT=6 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:33:54.094854 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aede92c8-704d-4b3a-a0ec-3b9ad105f4a0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:54.095314 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aede92c8-704d-4b3a-a0ec-3b9ad105f4a0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:54.096220 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aede92c8-704d-4b3a-a0ec-3b9ad105f4a0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:54.096703 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-aede92c8-704d-4b3a-a0ec-3b9ad105f4a0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:54.248182 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-aede92c8-704d-4b3a-a0ec-3b9ad105f4a0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:54.256545 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-aede92c8-704d-4b3a-a0ec-3b9ad105f4a0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.176734 Jul 07 07:33:54.257135 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 535/1087] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:54 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:55.273487 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-11e57931-fbc9-4678-90cf-145aae1e1970 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:55.274146 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-11e57931-fbc9-4678-90cf-145aae1e1970 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:55.281836 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11e57931-fbc9-4678-90cf-145aae1e1970 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:55.282323 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11e57931-fbc9-4678-90cf-145aae1e1970 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:55.283545 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11e57931-fbc9-4678-90cf-145aae1e1970 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:55.284350 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-11e57931-fbc9-4678-90cf-145aae1e1970 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:55.454492 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-11e57931-fbc9-4678-90cf-145aae1e1970 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:55.463057 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-11e57931-fbc9-4678-90cf-145aae1e1970 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.193177 Jul 07 07:33:55.463423 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 553/1088] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:55 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:55.554085 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-8fe9cc52-a1a7-4adf-8573-47fa179c7eef req-d4b0c834-04af-4ccd-9e79-c006c6d5c020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4075ace9-a7ae-4ba8-8108-21cf5e1ffb29", "name": "network-vif-plugged", "status": "completed", "tag": "1d28d474-8d4b-4905-8e13-4060328069b6"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:33:55.566850 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-8fe9cc52-a1a7-4adf-8573-47fa179c7eef req-d4b0c834-04af-4ccd-9e79-c006c6d5c020 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:55.567306 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-8fe9cc52-a1a7-4adf-8573-47fa179c7eef req-d4b0c834-04af-4ccd-9e79-c006c6d5c020 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:55.580096 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-8fe9cc52-a1a7-4adf-8573-47fa179c7eef req-d4b0c834-04af-4ccd-9e79-c006c6d5c020 service nova] Creating event network-vif-plugged:1d28d474-8d4b-4905-8e13-4060328069b6 for instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 on hv-cinder-82660 Jul 07 07:33:55.585783 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-8fe9cc52-a1a7-4adf-8573-47fa179c7eef req-d4b0c834-04af-4ccd-9e79-c006c6d5c020 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036669 Jul 07 07:33:55.587309 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 536/1089] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:33:56.484750 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1f6ee9cd-5556-4117-bb58-9cb7e83856c8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:56.485449 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1f6ee9cd-5556-4117-bb58-9cb7e83856c8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:56.493539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f6ee9cd-5556-4117-bb58-9cb7e83856c8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:56.493971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f6ee9cd-5556-4117-bb58-9cb7e83856c8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:56.494761 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f6ee9cd-5556-4117-bb58-9cb7e83856c8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:56.495224 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1f6ee9cd-5556-4117-bb58-9cb7e83856c8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:56.645961 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1f6ee9cd-5556-4117-bb58-9cb7e83856c8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:56.654920 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1f6ee9cd-5556-4117-bb58-9cb7e83856c8 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1263 microversion: 2.1 time: 0.174286 Jul 07 07:33:56.655532 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 554/1090] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:56 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:57.674283 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-63efe296-747d-4597-aa79-b4c82d9d9025 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:57.675101 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-63efe296-747d-4597-aa79-b4c82d9d9025 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:57.682759 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63efe296-747d-4597-aa79-b4c82d9d9025 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:57.683211 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63efe296-747d-4597-aa79-b4c82d9d9025 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:57.684548 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63efe296-747d-4597-aa79-b4c82d9d9025 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:57.686069 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-63efe296-747d-4597-aa79-b4c82d9d9025 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:57.851573 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-63efe296-747d-4597-aa79-b4c82d9d9025 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:57.860383 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-63efe296-747d-4597-aa79-b4c82d9d9025 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1449 microversion: 2.1 time: 0.191439 Jul 07 07:33:57.860996 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 537/1091] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:57 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1449 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:33:57.888799 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-6d0c3cd0-123f-4758-b8be-f2fad122b05e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:33:57.889971 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-6d0c3cd0-123f-4758-b8be-f2fad122b05e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:33:57.902349 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6d0c3cd0-123f-4758-b8be-f2fad122b05e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:57.903140 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6d0c3cd0-123f-4758-b8be-f2fad122b05e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:57.904623 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6d0c3cd0-123f-4758-b8be-f2fad122b05e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:33:57.905463 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-6d0c3cd0-123f-4758-b8be-f2fad122b05e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:33:58.076556 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-6d0c3cd0-123f-4758-b8be-f2fad122b05e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:33:58.090690 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-6d0c3cd0-123f-4758-b8be-f2fad122b05e tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1449 microversion: 2.1 time: 0.209088 Jul 07 07:33:58.091751 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 555/1092] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:33:57 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1449 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:34:00.259550 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-0ad62cc0-53d8-40f4-ba9b-93d206404b8f req-6586f8f7-8ea4-4457-b128-6f0148c262a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4075ace9-a7ae-4ba8-8108-21cf5e1ffb29", "tag": "1d28d474-8d4b-4905-8e13-4060328069b6"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:34:00.269102 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-0ad62cc0-53d8-40f4-ba9b-93d206404b8f req-6586f8f7-8ea4-4457-b128-6f0148c262a5 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:34:00.269579 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-0ad62cc0-53d8-40f4-ba9b-93d206404b8f req-6586f8f7-8ea4-4457-b128-6f0148c262a5 service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:34:00.282851 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-0ad62cc0-53d8-40f4-ba9b-93d206404b8f req-6586f8f7-8ea4-4457-b128-6f0148c262a5 service nova] Creating event network-changed:1d28d474-8d4b-4905-8e13-4060328069b6 for instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 on hv-cinder-82660 Jul 07 07:34:00.288318 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-0ad62cc0-53d8-40f4-ba9b-93d206404b8f req-6586f8f7-8ea4-4457-b128-6f0148c262a5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032526 Jul 07 07:34:00.288949 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 538/1093] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:35:28.289246 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:35:28.289932 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Thu Jul 7 07:35:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 07:35:40.173585 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_api:SELECT=20 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:35:40.174519 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG dbcounter [-] [117787] Writing DB stats nova_cell1:SELECT=48 {{(pid=117787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:35:40.179745 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-d264fa2a-ea52-4157-b6bf-bb0680074b9c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:40.180251 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d264fa2a-ea52-4157-b6bf-bb0680074b9c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:40.181750 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:35:40.182969 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG dbcounter [-] [117788] Writing DB stats nova_cell1:SELECT=44 {{(pid=117788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 07:35:40.189059 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d264fa2a-ea52-4157-b6bf-bb0680074b9c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:40.189632 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d264fa2a-ea52-4157-b6bf-bb0680074b9c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:40.190424 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d264fa2a-ea52-4157-b6bf-bb0680074b9c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:40.190860 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-d264fa2a-ea52-4157-b6bf-bb0680074b9c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:40.220925 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-d264fa2a-ea52-4157-b6bf-bb0680074b9c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:35:40.303080 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-6bdae758-0a11-4f40-a136-45020d03724e req-f46be338-48b3-48e4-92d4-bb5088f41e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4075ace9-a7ae-4ba8-8108-21cf5e1ffb29", "tag": "1d28d474-8d4b-4905-8e13-4060328069b6"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:35:40.312176 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-6bdae758-0a11-4f40-a136-45020d03724e req-f46be338-48b3-48e4-92d4-bb5088f41e1d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:40.313168 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-6bdae758-0a11-4f40-a136-45020d03724e req-f46be338-48b3-48e4-92d4-bb5088f41e1d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:40.325547 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-d264fa2a-ea52-4157-b6bf-bb0680074b9c tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 204 len: 0 microversion: 2.1 time: 0.152961 Jul 07 07:35:40.325953 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-6bdae758-0a11-4f40-a136-45020d03724e req-f46be338-48b3-48e4-92d4-bb5088f41e1d service nova] Creating event network-changed:1d28d474-8d4b-4905-8e13-4060328069b6 for instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 on hv-cinder-82660 Jul 07 07:35:40.329791 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 556/1094] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:35:40 2022] DELETE /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:35:40.332580 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-6bdae758-0a11-4f40-a136-45020d03724e req-f46be338-48b3-48e4-92d4-bb5088f41e1d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153695 Jul 07 07:35:40.333278 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 539/1095] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:35:40.342157 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c7926a4a-7257-432b-a229-b0dfc1724fb2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:40.343912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c7926a4a-7257-432b-a229-b0dfc1724fb2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:40.351568 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c7926a4a-7257-432b-a229-b0dfc1724fb2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:40.353435 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c7926a4a-7257-432b-a229-b0dfc1724fb2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:40.353435 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c7926a4a-7257-432b-a229-b0dfc1724fb2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:40.353859 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c7926a4a-7257-432b-a229-b0dfc1724fb2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:40.621588 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c7926a4a-7257-432b-a229-b0dfc1724fb2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:35:40.629414 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c7926a4a-7257-432b-a229-b0dfc1724fb2 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1573 microversion: 2.1 time: 0.297816 Jul 07 07:35:40.630125 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 557/1096] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:35:40 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1573 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:35:41.648970 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-4be7462f-ec14-4b29-b3f7-32ebbe9eff57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:41.649669 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-4be7462f-ec14-4b29-b3f7-32ebbe9eff57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:41.656507 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4be7462f-ec14-4b29-b3f7-32ebbe9eff57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:41.656952 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4be7462f-ec14-4b29-b3f7-32ebbe9eff57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:41.657763 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4be7462f-ec14-4b29-b3f7-32ebbe9eff57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:41.658239 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-4be7462f-ec14-4b29-b3f7-32ebbe9eff57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:41.876440 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-4be7462f-ec14-4b29-b3f7-32ebbe9eff57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:35:41.885331 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-4be7462f-ec14-4b29-b3f7-32ebbe9eff57 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1573 microversion: 2.1 time: 0.241085 Jul 07 07:35:41.886143 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 540/1097] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:35:41 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1573 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:35:42.906309 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-699710ba-27b3-418e-843d-47eb8cbe998a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:42.907669 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-699710ba-27b3-418e-843d-47eb8cbe998a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:42.915645 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-699710ba-27b3-418e-843d-47eb8cbe998a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:42.916180 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-699710ba-27b3-418e-843d-47eb8cbe998a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:42.917183 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-699710ba-27b3-418e-843d-47eb8cbe998a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:42.917745 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-699710ba-27b3-418e-843d-47eb8cbe998a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:42.995758 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-0366b6bf-47b2-4750-b76d-10a01c8ea3fb req-12461532-3bd8-4061-a347-3612f940341d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4075ace9-a7ae-4ba8-8108-21cf5e1ffb29", "name": "network-vif-deleted", "tag": "1d28d474-8d4b-4905-8e13-4060328069b6"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:35:42.996989 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-699710ba-27b3-418e-843d-47eb8cbe998a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:35:43.005805 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-0366b6bf-47b2-4750-b76d-10a01c8ea3fb req-12461532-3bd8-4061-a347-3612f940341d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:43.006220 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-0366b6bf-47b2-4750-b76d-10a01c8ea3fb req-12461532-3bd8-4061-a347-3612f940341d service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:43.009907 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-699710ba-27b3-418e-843d-47eb8cbe998a tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1389 microversion: 2.1 time: 0.109578 Jul 07 07:35:43.011360 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 558/1098] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:35:42 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1389 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:35:43.019018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-0366b6bf-47b2-4750-b76d-10a01c8ea3fb req-12461532-3bd8-4061-a347-3612f940341d service nova] Creating event network-vif-deleted:1d28d474-8d4b-4905-8e13-4060328069b6 for instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 on hv-cinder-82660 Jul 07 07:35:43.026007 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-0366b6bf-47b2-4750-b76d-10a01c8ea3fb req-12461532-3bd8-4061-a347-3612f940341d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033658 Jul 07 07:35:43.026929 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 541/1099] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 07 07:35:44.035180 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:44.035876 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:44.043467 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:44.044083 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:44.045300 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:44.045749 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:44.089948 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:44.090386 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:44.090829 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.objects.instance [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lazy-loading 'fault' on Instance uuid 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 {{(pid=117787) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 07 07:35:44.134106 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:35:44.144194 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-1600cac0-9c4c-42ce-b102-bfc79cef19cf tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 200 len: 1183 microversion: 2.1 time: 0.113244 Jul 07 07:35:44.144769 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 559/1100] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:35:44 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 1183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:35:45.163316 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-35df6da6-ad89-43bf-8715-2f439aaa2cf5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:45.164007 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-35df6da6-ad89-43bf-8715-2f439aaa2cf5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:45.171236 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35df6da6-ad89-43bf-8715-2f439aaa2cf5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:45.171690 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35df6da6-ad89-43bf-8715-2f439aaa2cf5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:45.172480 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35df6da6-ad89-43bf-8715-2f439aaa2cf5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:45.172917 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-35df6da6-ad89-43bf-8715-2f439aaa2cf5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:45.187755 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-35df6da6-ad89-43bf-8715-2f439aaa2cf5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] HTTP exception thrown: Instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 could not be found. Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-35df6da6-ad89-43bf-8715-2f439aaa2cf5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Request method failure captured: Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 HTTP/1.1 Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixosXv1hTCG-ejh-vETmNHt4xW1uqrQ38U3yQiGuzT2ex8GwV-oDeMpvd9cqWCHnRAA85AwP3EBRIcxBW2B_uKGj71rnhF-i2V7s-fECSnnecoeNp1aAY5JNNEcMqJSGlhAfaYTMzKsotNuxDoaKrEPstbcVevo0PO0m9Pw5BDylEIUw Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: aafd6d9a6d134f538a61498790991c0c Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:35:45.189483 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: aafd6d9a6d134f538a61498790991c0c Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-TestVolumeBootPattern-1826107771-project Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 63d931e360f94cf78880ec2f2970a066 Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestVolumeBootPattern-1826107771-project Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 could not be found. Jul 07 07:35:45.191539 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '4075ace9-a7ae-4ba8-8108-21cf5e1ffb29'} Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 could not be found. Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:35:45.192620 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 could not be found. Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 could not be found. Jul 07 07:35:45.194188 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:35:45.195700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-35df6da6-ad89-43bf-8715-2f439aaa2cf5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Returning 404 to user: Instance 4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:35:45.195700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-35df6da6-ad89-43bf-8715-2f439aaa2cf5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29" status: 404 len: 111 microversion: 2.1 time: 0.032665 Jul 07 07:35:45.195700 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 542/1101] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:35:45 2022] GET /compute/v2.1/servers/4075ace9-a7ae-4ba8-8108-21cf5e1ffb29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:35:48.672554 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-57da9c41-6414-4d76-83f6-4f8c4eb3bf88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:48.673145 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-57da9c41-6414-4d76-83f6-4f8c4eb3bf88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:48.674794 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [req-6c732915-2ac7-4ceb-9ce7-10b1749b89f9 req-5778839c-448b-4293-854c-5716dcd467bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c", "tag": "0fb99e77-9a43-4db0-98a1-5a9a172cd230"}]} {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:35:48.680410 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57da9c41-6414-4d76-83f6-4f8c4eb3bf88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:48.680868 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57da9c41-6414-4d76-83f6-4f8c4eb3bf88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:48.681701 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57da9c41-6414-4d76-83f6-4f8c4eb3bf88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:48.682538 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-57da9c41-6414-4d76-83f6-4f8c4eb3bf88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:48.685494 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-6c732915-2ac7-4ceb-9ce7-10b1749b89f9 req-5778839c-448b-4293-854c-5716dcd467bf service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:48.686018 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [req-6c732915-2ac7-4ceb-9ce7-10b1749b89f9 req-5778839c-448b-4293-854c-5716dcd467bf service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:48.700998 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.compute.server_external_events [req-6c732915-2ac7-4ceb-9ce7-10b1749b89f9 req-5778839c-448b-4293-854c-5716dcd467bf service nova] Creating event network-changed:0fb99e77-9a43-4db0-98a1-5a9a172cd230 for instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c on hv-cinder-82660 Jul 07 07:35:48.707323 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [req-6c732915-2ac7-4ceb-9ce7-10b1749b89f9 req-5778839c-448b-4293-854c-5716dcd467bf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036371 Jul 07 07:35:48.708401 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 543/1102] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:35:48.721779 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-57da9c41-6414-4d76-83f6-4f8c4eb3bf88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Going to try to terminate instance {{(pid=117787) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 07 07:35:48.818970 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-57da9c41-6414-4d76-83f6-4f8c4eb3bf88 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 204 len: 0 microversion: 2.1 time: 0.150093 Jul 07 07:35:48.819963 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 560/1103] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:35:48 2022] DELETE /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 07 07:35:48.829882 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-47b7a4c7-7cc9-423b-bcca-dfdfc983c2aa tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:48.831642 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-47b7a4c7-7cc9-423b-bcca-dfdfc983c2aa tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:48.839062 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47b7a4c7-7cc9-423b-bcca-dfdfc983c2aa tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:48.839982 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47b7a4c7-7cc9-423b-bcca-dfdfc983c2aa tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:48.840878 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47b7a4c7-7cc9-423b-bcca-dfdfc983c2aa tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:48.841577 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-47b7a4c7-7cc9-423b-bcca-dfdfc983c2aa tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:49.012457 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-47b7a4c7-7cc9-423b-bcca-dfdfc983c2aa tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:35:49.021402 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-47b7a4c7-7cc9-423b-bcca-dfdfc983c2aa tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1574 microversion: 2.1 time: 0.196264 Jul 07 07:35:49.022383 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 544/1104] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:35:48 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1574 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:35:50.044620 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-c943d54d-3188-42eb-be94-5df6e0714cfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:50.045369 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-c943d54d-3188-42eb-be94-5df6e0714cfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:50.053304 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c943d54d-3188-42eb-be94-5df6e0714cfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:50.053721 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c943d54d-3188-42eb-be94-5df6e0714cfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:50.054539 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c943d54d-3188-42eb-be94-5df6e0714cfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:50.054953 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-c943d54d-3188-42eb-be94-5df6e0714cfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:50.229388 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.policy [None req-c943d54d-3188-42eb-be94-5df6e0714cfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117787) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:35:50.243209 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-c943d54d-3188-42eb-be94-5df6e0714cfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1574 microversion: 2.1 time: 0.202845 Jul 07 07:35:50.243912 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 561/1105] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:35:50 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1574 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:35:51.268570 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-fb351235-8900-422c-9f82-f04fc08b4bfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:51.269169 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-fb351235-8900-422c-9f82-f04fc08b4bfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:51.276618 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb351235-8900-422c-9f82-f04fc08b4bfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:51.277054 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb351235-8900-422c-9f82-f04fc08b4bfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:51.278098 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb351235-8900-422c-9f82-f04fc08b4bfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:51.278540 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-fb351235-8900-422c-9f82-f04fc08b4bfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:51.303756 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [req-c81d5075-c108-4e1e-a186-ed03dad252c3 req-7d4aabbe-cfc9-481e-9304-a6bdc89d14cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c", "name": "network-vif-deleted", "tag": "0fb99e77-9a43-4db0-98a1-5a9a172cd230"}]} {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 07 07:35:51.315762 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c81d5075-c108-4e1e-a186-ed03dad252c3 req-7d4aabbe-cfc9-481e-9304-a6bdc89d14cc service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:51.316581 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [req-c81d5075-c108-4e1e-a186-ed03dad252c3 req-7d4aabbe-cfc9-481e-9304-a6bdc89d14cc service nova] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:51.332340 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.compute.server_external_events [req-c81d5075-c108-4e1e-a186-ed03dad252c3 req-7d4aabbe-cfc9-481e-9304-a6bdc89d14cc service nova] Creating event network-vif-deleted:0fb99e77-9a43-4db0-98a1-5a9a172cd230 for instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c on hv-cinder-82660 Jul 07 07:35:51.338533 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [req-c81d5075-c108-4e1e-a186-ed03dad252c3 req-7d4aabbe-cfc9-481e-9304-a6bdc89d14cc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038894 Jul 07 07:35:51.339573 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 562/1106] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Jul 7 07:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 07 07:35:51.375311 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.policy [None req-fb351235-8900-422c-9f82-f04fc08b4bfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63d931e360f94cf78880ec2f2970a066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aafd6d9a6d134f538a61498790991c0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117788) authorize /opt/stack/nova/nova/policy.py:199}} Jul 07 07:35:51.387082 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-fb351235-8900-422c-9f82-f04fc08b4bfc tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 200 len: 1389 microversion: 2.1 time: 0.122558 Jul 07 07:35:51.387680 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 545/1107] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:35:51 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 1389 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 07 07:35:52.405749 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fb57f499-36e3-462e-8e96-872903c2cba0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:52.406639 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-fb57f499-36e3-462e-8e96-872903c2cba0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:52.413867 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb57f499-36e3-462e-8e96-872903c2cba0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:52.414343 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb57f499-36e3-462e-8e96-872903c2cba0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:52.415150 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb57f499-36e3-462e-8e96-872903c2cba0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:52.415589 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-fb57f499-36e3-462e-8e96-872903c2cba0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:52.430890 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-fb57f499-36e3-462e-8e96-872903c2cba0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] HTTP exception thrown: Instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c could not be found. Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fb57f499-36e3-462e-8e96-872903c2cba0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Request method failure captured: Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c HTTP/1.1 Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixosXv1hTCG-ejh-vETmNHt4xW1uqrQ38U3yQiGuzT2ex8GwV-oDeMpvd9cqWCHnRAA85AwP3EBRIcxBW2B_uKGj71rnhF-i2V7s-fECSnnecoeNp1aAY5JNNEcMqJSGlhAfaYTMzKsotNuxDoaKrEPstbcVevo0PO0m9Pw5BDylEIUw Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: aafd6d9a6d134f538a61498790991c0c Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:35:52.432622 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: aafd6d9a6d134f538a61498790991c0c Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-TestVolumeBootPattern-1826107771-project Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 63d931e360f94cf78880ec2f2970a066 Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestVolumeBootPattern-1826107771-project Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c could not be found. Jul 07 07:35:52.435490 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': 'c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c'} Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c could not be found. Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:35:52.436537 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c could not be found. Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c could not be found. Jul 07 07:35:52.438101 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:35:52.439329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-fb57f499-36e3-462e-8e96-872903c2cba0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Returning 404 to user: Instance c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:35:52.439329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-fb57f499-36e3-462e-8e96-872903c2cba0 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c" status: 404 len: 111 microversion: 2.1 time: 0.033595 Jul 07 07:35:52.439329 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 563/1108] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:35:52 2022] GET /compute/v2.1/servers/c1e1b4b4-60bd-40e3-bdf9-00bcb1b28b7c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:35:52.986199 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9a649ca9-5bb7-459b-9bbd-7afb759f67f5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:52.986909 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.compute.api [None req-9a649ca9-5bb7-459b-9bbd-7afb759f67f5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117788) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:52.994614 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a649ca9-5bb7-459b-9bbd-7afb759f67f5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:52.995075 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a649ca9-5bb7-459b-9bbd-7afb759f67f5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:52.995851 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a649ca9-5bb7-459b-9bbd-7afb759f67f5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:52.996317 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG oslo_concurrency.lockutils [None req-9a649ca9-5bb7-459b-9bbd-7afb759f67f5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117788) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:53.012027 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.wsgi [None req-9a649ca9-5bb7-459b-9bbd-7afb759f67f5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] HTTP exception thrown: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9a649ca9-5bb7-459b-9bbd-7afb759f67f5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Request method failure captured: Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: request: DELETE /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 HTTP/1.1 Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept: application/json Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Accept-Encoding: identity Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Connection: close Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Length: 0 Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Content-Type: application/json Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Host: 10.222.0.62 Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Openstack-System-Scope: None Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: User-Agent: python-urllib3/1.26.9 Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Auth-Token: gAAAAABixosXv1hTCG-ejh-vETmNHt4xW1uqrQ38U3yQiGuzT2ex8GwV-oDeMpvd9cqWCHnRAA85AwP3EBRIcxBW2B_uKGj71rnhF-i2V7s-fECSnnecoeNp1aAY5JNNEcMqJSGlhAfaYTMzKsotNuxDoaKrEPstbcVevo0PO0m9Pw5BDylEIUw Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Id: None Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Domain-Name: None Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Identity-Status: Confirmed Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Is-Admin-Project: True Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Id: default Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Domain-Name: Default Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Id: aafd6d9a6d134f538a61498790991c0c Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Project-Name: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Role: member,reader Jul 07 07:35:53.013828 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Roles: member,reader Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Id: aafd6d9a6d134f538a61498790991c0c Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User: tempest-TestVolumeBootPattern-1826107771-project Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Id: default Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Domain-Name: Default Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Id: 63d931e360f94cf78880ec2f2970a066 Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: X-User-Name: tempest-TestVolumeBootPattern-1826107771-project Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: method: > Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: exception: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:35:53.016296 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: action_args: {'id': '66306d61-37aa-44d9-a9c0-cf1d1f778708'} Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:35:53.017486 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:35:53.019081 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: ERROR nova.api.openstack.wsgi Jul 07 07:35:53.020753 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-9a649ca9-5bb7-459b-9bbd-7afb759f67f5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Returning 404 to user: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. {{(pid=117788) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:35:53.020753 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-9a649ca9-5bb7-459b-9bbd-7afb759f67f5 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "DELETE /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 404 len: 111 microversion: 2.1 time: 0.033476 Jul 07 07:35:53.020753 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 546/1109] 10.222.0.62 () {58 vars in 1238 bytes} [Thu Jul 7 07:35:52 2022] DELETE /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:35:53.025558 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b3b1c1da-88ca-497c-9944-0cf3ea296217 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '>' {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:53.026186 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.compute.api [None req-b3b1c1da-88ca-497c-9944-0cf3ea296217 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] [instance: 66306d61-37aa-44d9-a9c0-cf1d1f778708] Fetching instance by UUID {{(pid=117787) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 07 07:35:53.033164 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3b1c1da-88ca-497c-9944-0cf3ea296217 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:53.033665 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3b1c1da-88ca-497c-9944-0cf3ea296217 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:53.034638 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3b1c1da-88ca-497c-9944-0cf3ea296217 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 07 07:35:53.035115 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG oslo_concurrency.lockutils [None req-b3b1c1da-88ca-497c-9944-0cf3ea296217 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Lock "0c0cfef6-5327-469c-98b5-96dc22a57a03" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 07 07:35:53.050791 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.wsgi [None req-b3b1c1da-88ca-497c-9944-0cf3ea296217 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] HTTP exception thrown: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b3b1c1da-88ca-497c-9944-0cf3ea296217 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Request method failure captured: Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: request: GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 HTTP/1.1 Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept: application/json Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Accept-Encoding: identity Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Connection: close Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Length: 0 Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Content-Type: application/json Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Host: 10.222.0.62 Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Openstack-System-Scope: None Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: User-Agent: python-urllib3/1.26.9 Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Auth-Token: gAAAAABixosXv1hTCG-ejh-vETmNHt4xW1uqrQ38U3yQiGuzT2ex8GwV-oDeMpvd9cqWCHnRAA85AwP3EBRIcxBW2B_uKGj71rnhF-i2V7s-fECSnnecoeNp1aAY5JNNEcMqJSGlhAfaYTMzKsotNuxDoaKrEPstbcVevo0PO0m9Pw5BDylEIUw Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Id: None Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Domain-Name: None Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Identity-Status: Confirmed Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Is-Admin-Project: True Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Id: default Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Domain-Name: Default Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Id: aafd6d9a6d134f538a61498790991c0c Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Project-Name: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Role: member,reader Jul 07 07:35:53.052609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Roles: member,reader Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/aafd6d9a6d134f538a61498790991c0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Id: aafd6d9a6d134f538a61498790991c0c Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-Tenant-Name: tempest-TestVolumeBootPattern-1826107771 Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User: tempest-TestVolumeBootPattern-1826107771-project Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Id: default Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Domain-Name: Default Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Id: 63d931e360f94cf78880ec2f2970a066 Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: X-User-Name: tempest-TestVolumeBootPattern-1826107771-project Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: method: > Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: exception: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:35:53.054507 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: action_args: {'id': '66306d61-37aa-44d9-a9c0-cf1d1f778708'} Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: {{(pid=117787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 07 07:35:53.055505 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. Jul 07 07:35:53.057127 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: ERROR nova.api.openstack.wsgi Jul 07 07:35:53.058731 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: DEBUG nova.api.openstack.wsgi [None req-b3b1c1da-88ca-497c-9944-0cf3ea296217 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Returning 404 to user: Instance 66306d61-37aa-44d9-a9c0-cf1d1f778708 could not be found. {{(pid=117787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 07 07:35:53.058731 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO nova.api.openstack.requestlog [None req-b3b1c1da-88ca-497c-9944-0cf3ea296217 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708" status: 404 len: 111 microversion: 2.1 time: 0.032813 Jul 07 07:35:53.058731 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: [pid: 117787|app: 0|req: 564/1110] 10.222.0.62 () {58 vars in 1235 bytes} [Thu Jul 7 07:35:53 2022] GET /compute/v2.1/servers/66306d61-37aa-44d9-a9c0-cf1d1f778708 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 07 07:35:54.391210 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: DEBUG nova.api.openstack.wsgi [None req-ccf74eef-5a8e-4e78-891d-f603f300f5c6 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] Calling method '.version_select at 0x7fccfa03ab80>' {{(pid=117788) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 07 07:35:54.417476 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO nova.api.openstack.requestlog [None req-ccf74eef-5a8e-4e78-891d-f603f300f5c6 tempest-TestVolumeBootPattern-1826107771 tempest-TestVolumeBootPattern-1826107771-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-820613128" status: 202 len: 0 microversion: 2.1 time: 0.030113 Jul 07 07:35:54.419022 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: [pid: 117788|app: 0|req: 547/1111] 10.222.0.62 () {58 vars in 1259 bytes} [Thu Jul 7 07:35:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-820613128 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 07 07:36:57.099948 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:36:57.100609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Thu Jul 7 07:36:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 07:38:43.830626 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:38:43.831449 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Thu Jul 7 07:38:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 07:38:48.299510 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:38:48.300264 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Thu Jul 7 07:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 07:38:52.418282 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:38:52.418979 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Thu Jul 7 07:38:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 07:39:07.972098 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:39:07.972928 dv-cinder-826608-5-iscsi devstack@n-api.service[117788]: Thu Jul 7 07:39:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 07:39:09.671609 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:39:09.672341 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Thu Jul 7 07:39:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 07 07:40:17.110032 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 07 07:40:17.111195 dv-cinder-826608-5-iscsi devstack@n-api.service[117787]: Thu Jul 7 07:40:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!